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AN OPERATIONAL EVALUATION OF HEAD-UP DISPLAYS FOR CIVIL TRANSPORT OPERATIONS 


NASA/FAA PHASE III FINAL REPORT 
J. K. Lauber,* R. S. Bray,* R. L. Harrison,* J. C. Hemingway,* and B. C. Scottt 


Ten airline captains currently qualified in the B-727 aircraft flew a series of simulated instrument-landing system (ILS) 
and localizer-only approaches in a motion base simulator using both a flight director head-up display (HUD) concept and 
a flightpath HUD concept as well as conventional head-down instruments under a variety of environmental and operational 
conditions to assess: (a) the potential benefits of these HUDs in airline operations; (b) problems which might be associated 
with their use; and (c) flight-crew training requirements and flight-crew operating procedures suitable for use with the HUDs. 
The results, based on objective simulator based performance measures, subject pilot opinion and rating data, and observer 
data, included the following: (1) The subject pilot group expressed a preference for both HUD concepts over conventional 
instruments; (2) accuracy and precision of pilot control of some flight parameters during approaches in a variety of 
conditions were improved when the pilots used either HUD, but the largest improvement was with the flightpath HUD; and 
(3) the HUD training programs developed for this study yielded good performance using unfamiliar display concepts and 
were highly regarded by the subject pilots. 


INTRODUCTION 

Background and Statement of the Problem 

The experiment reported here is the culmination of a 
series of studies conducted under a joint agreement 
between the FAA and NASA. (See the paper by Haines 
(1978) for details of program plan.) As stated by Haines 
the objectives of the program were to evaluate the advan- 
tages and disadvantages of head-up displays (HUD) in 
commercial-jet-transport approach and landing operations. 
The program was organized into four major phases: Phase I, 
for which the FAA had major responsibility, was a 
review of the relevant literature and an analysis of the 
major issues surrounding HUD. The results of this effort 
were published by Shrager (1978). 

The NASA-Ames Research Center had major responsi- 
bility for Phase II and Phase III. Phase II had two major 
objectives: (1) to evaluate certain fundamental human- 
factor issues relating to the design and operation of HUDs; 
and (2) to develop candidate HUD concepts to be eval- 
uated in Phase III. These Phase II laboratory and simu- 
lator experiments have been reported elsewhere, and 
a complete list of authors and titles is given in appendix A. 


*NASA-Ames Research Center, Moffett Field, California, 
t Federal Aviation Administration, Moffett Field, California. 


Phase III of the program, the subject of this report, con- 
sisted of a simulator evaluation using two different head-up 
display concepts as well as conventional head-down instru- 
ments under a variety of environmental and operational 
conditions to determine: (1) the potential benefits of these 
HUDs in airline operations; (2) problems which might be 
associated with their use; and (3) flight-crew training 
requirements and flight-crew operating procedures suitable 
for use with the HUDs. 

Finally, Phase IV of the program is an FAA responsibil- 
ity and consists of actual flight tests of a HUD concept in 
an FAA B-727 aircraft. This effort is underway at present 
and will be reported in a future FAA paper. 

The primary focus of this program was to conduct an 
operational evaluation of these HUD concepts during man- 
ually flown jet transport terminal area operations with 
CAT 1 or better visibilities and normal environmental condi- 
tions. Subjective evaluations and standard approach perfor- 
mance measures were collected. This program did not 
address very low visibility operations, the suitability of 
these HUDs for monitoring auto-land operations or any 
economic considerations relating to head-up displays. 

Operational History of Head-Up Displays 

The head-up display is not a new concept (see Naish, 
1979). The modern head-up display is the product of a 
continuous evolution which began with airborne optical 
gunsights developed during World War II. In keeping with 


its military origin, the HUD concept has seen wide applica- 
tion in military aircraft, primarily as an assist to the tacti- 
cal mission of attack and fighter aircraft, viz, in weapons 
delivery. Although some military HUDs have approach and 
landing guidance functions, it has not been until recently 
that an attempt has been made to fully develop and utilize 
military HUDs for final approach, flare, and landing guid- 
ance. Because of these factors, accumulated experience 
design and operational use of military HUDs is of limited 
value in trying to assess the advantages and disadvantages 
of HUDs in civil-jet-transport aircraft operations. 

Civil experience with the HUD concept is much more 
limited. At present, there are only two known applications 
of HUDs in civil-transport operations world-wide, and 
both of these are electromechanical reticule devices 
designed to present limited special purpose information. 
In one case, a carrier flying twin-jet transports into Arctic 
gravel-runway airports with no electronic or visual glide- 
slope information available is using a simple, visual- 
meteorological-condition (VMC) — only head-up display 
to provide flightpath guidance during the final approach. 
In the other case, the HUD is being used to provide moni- 
toring of and manual-backup capability for a fail passive 
autopilot for CAT III operations. A third application of 
HUD wiQ be available in the near future. The Douglas 
Aircraft Company is offering a HUD option on the 
DC-9-80. This HUD is designed for use in manually con- 
trolled approaches and as a monitor of the performance of 
the autopilot during autoland. In the latter application, the 
ultimate objective of the HUD system is to provide the 
pilot with sufficiently accurate instrument guidance cues in 
the windscreen area to complete a manual approach follow- 
ing a failure of the autopilot at or below decision height 
(DH) in CAT Ilia (RVR less than 1200 ft). 

A paucity of operational and experimental data with 
regard to the more general application of HUDs still exists. 
Many questions remain unanswered. Are there performance 
benefits to be gained by using a head-up display? Are there 
any difficulties or hazards associated with their use? What 
training will be required before initiating use of HUDs in 
line operations? Will the line pilots accept or reject these 
new displays? Questions like these and the recognition that 
the lack of sufficient vertical-guidance information has 
been a major contributory cause in jet transport accidents 
have provided the major justification for the NASA/FAA 
program. 

Potential Benefits and Problems of the Head-Up 
Display Concept 

Before the Phase III experiment and its results are 
described, the potential benefits which have been ascribed 
to the head-up display and some of the potential problems 


associated with its use will be discussed. The following 
paragraphs constitute an overview only; detailed discussions 
may be found in references by Shrager (1978) and Jenny, 
Malone, and Schwackert (1971). 

The principal benefit claimed for the HUD concept is 
that the pilot’s ability to utilize both instrument informa- 
tion and environmental visual cues is greatly enhanced 
because the symbology is presented at optical infinity 
through a semitransparent combiner plate placed at the 
pilot’s througJiTthe-v^dshield line of sight. This enhance- 
ment is presumed to come from the elimination of the 
necessity for physical movement of the head and eyes from 
the instrument panel to the windscreen and vice versa, and 
the elimination of the necessity for the eye to refocus 
(accommodate) as the point of regard moves from panel to 
windscreen. The total time required for these movements 
can be as much as several seconds (Tucker and Charman, 
1979) and, therefore, their elimination presumably would 
enhance the use of both sources of information. 

One potential benefit that is available only through the 
use .of HUD is the notion of display conformality, that is, 
synthetic, electronically generated, and displayed elements 
overlay (or conform to) corresponding objects in the real 
world. Conformality offers two potential benefits: 
(1) Synthetic display elements which can be flown with 
reference to some real-world counterpart provide a synthe- 
sis of information otherwise unobtainable (e.g., a synthetic 
flightpath symbol flown with reference to the desired 
touchdown point on the actual runway); (2) The presence 
of the synthetic symbol shows the pilot where to “look 
for” the corresponding real-world element, thereby pre- 
sumably enhancing his ability to detect and assess the 
real-world visual cues. 

In arguing that these features are benefits, certain 
assumptions must be made. One is that no useful informa- 
tion is being obtained during the head/eye movements and 
refocusing. Also, in order to argue that HUD improves the 
pilot’s ability to detect and utilize marginal real-world 
visual cues, it must be assumed that the degree of obscura- 
tion of the environmental visual cues by the HUD optics 
and symbology is acceptable. These considerations were of 
major importance in determining the general approach used 
to evaluate the HUD concept in this program. If the pilot’s 
ability to utilize each source of information is enhanced by 
HUD, then corresponding changes in performance on tasks 
which are dependent upon information from either or both 
sources ought to be seen. This rationale was fundamental 
in the selection of the environmental and operational test 
conditions and the performance measures used in this 
study. 
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APPROACH 

Description of Head-Up Display Concepts 
Used in Phase 111 

Three major functional capabilities were required of the 
HUDs used in Phase III: (1) The HUDs must provide the 
capability for conducting both precision and nonprecision 
approaches; (2) the HUDs must provide sufficient informa- 
tion so that they can be used for terminal area maneuvering 
(e.g., flying on radar vectors, intercepting and flying the 
final approach to a flare and landing, or initiating a missed 
approach maneuver); and (3) the HUDs must be “full time” 
in the sense that they must contain sufficient information 
to enable the pilot to conduct these maneuvers solely by 
reference to the HUD symbology. Flare guidance was not 
specifically required, nor were other secondary HUD design 
issues considered (e.g., the display of caution and warning 
information). It was believed, however, that the functional 
capabilities described previously were reasonable in the 
sense that any commercially viable HUD would probably 
contain at least some of these features. 

Early in the Phase III program, a major question arose 
which had a significant impact upon the conduct of the 
study. In an experimental evaluation of a HUD which con- 
tains information currently not available to the pilot, how 
can the researcher discern whether any performance differ- 
ences are due to the presence of the new information or to 
the fact that the information is displayed head-up (i.e., 
superimposed on the real-world scene)? 

Initially, an attempt was made to consider one aspect of 
the question by requiring the use of two different design 
philosophies; for one of these, no restrictions were placed 
upon the kinds of information that would be included in 
the HUD; in the second case, the HUD could contain only 
information that is currently available on the instrument 
panel. This restriction precluded the use of flightpath or 
potential flightpath, and, in effect, dictated that only raw 
data and/or flight-director guidance be used. However, 
precluding the use of any “new” information would have 
limited the flight-director display concept to a laboratory 
curiosity with no commercial viability. Given that the 
major objective of the Phase III program was to evaluate 
the potential contributions and problems of head-up 
displays in line operations, the rule was relaxed to permit 
the addition of a simple flightpath display element for use 
during the VMC portion of nonprecision approaches. The 
question of new information versus sjmibology location 
was not further addressed in this study. 

Flight-Director HUD 

General description— The fli^t-director HUD (FD 
HUD) used in this study was basically an unreferenced 


display (i.e., no element of the display except the horizon 
was earth referenced) with provisions for nonprecision 
and visual approaches. Using computed information, the 
display provided fly-to roll and pitch steering commands 
in a manner exactly analogous to conventional head-down 
flight director displays. For nonprecision and visual- 
approach operations, the flight-director elements were 
replaced by switch-selectable fixed-depression or flight- 
path (delta gamma) elements flown with reference to the 
intended touchdown point on the runway. 

Major central display elements- Flight-director guid- 
was provided on the display by a movable dot located 
at the apex of a stack of three crossbars (see fig. 1). The 
pilot’s task was to fly the aircraft symbol (the circle with 
“wings” onto the steering dot). In reality, the aircraft sym- 
bol remained fixed in the center of the display and the dot 
moved, either parallel to the horizon for lateral commands 
or perpendicular to the horizon for vertical commands. 

The three crossbars, which moved the steering dot, 
were designed both to assist the pilot in locating the steer- 
ing dot without having to fixate upon it and to provide a 
roll reference for those situations in which the artificial 
horizon would disappear from the display (e.g., large 
pitch angles). 

The artificial horizon was a long bar with a central gap 
to accommodate the aircraft symbol. Bank angles were 
indicated by keeping the horizon line parallel with the 
earth’s horizon at all times. In order to keep the horizon 
line within the small field of view (12° + 12°) of this dis- 
play, movements of the horizon in pitch were reduced by 
a factor of 5 : 1 . 

The aircraft symbol provided basic pitch and roll atti- 
tude information. In addition, airspeed error was displayed 
by means of a vertical bar which grew out of the top of 
the aircraft symbol to indicate positive speed errors and 
out of the bottom to show negative speed errors. The ref- 
erence speed was manually set by means of a knob and 
movable “bug” on the panel-mounted airspeed indicator. 

For visual-approach operations, the pilot selected either 
of two modes: a depression line which was fixed at 3 
below the horizon, or a flightpath line (actually delta- 
gamma) (see fig. 2). These modes, selected by means of 
lateral movement of an otherwise conventional “coolie hat” 
thumb switch on the yoke, were used to determine devia- 
tion from a nominal 3° flightpath and to assist the pilot 
in flying to the desired touchdown point on the runway. 
(See Naish (1979) for a complete description of the delta- 
gamma flightpath display.) 

Major peripheral display elements— Heading information 
was provided by a horizontally moving tape at the top of 
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the display. Heading tabs were provided at 5° intervals, 
and heading was marked with two-digit numerals at 10° 
intervals. 

Raw-data glide-slope and localizer information were 
shown on the right side and bottom of the display, respec- 
tively. Scaling and sensing were equivalent to conven- 
tional head-down instruments. In addition, gates showing 
maximum permissible deviations as functions of altitude 
were shown in the form of a pair of lines growing from the 
outermost dots on both scales. 

On the left side of the display was a vertical scale which 
showed instantaneous vertical speed. Reference marks were 
provided for +1000 ft/min (top), 0 ft/min (center), and 
-1000 ft/min (bottom). 

Airspeed and altitude were displayed in digital format 
on the upper left and right sides of the display, respectively. 
Airspeed was indicated to the nearest knot, and altitude 
(radio altitude in this study) was displayed to the nearest 
10 ft. 

On the lower left side of the display, a digital readout of 
engine pressure ratio (EPR) for the no. 2 (center) engine 
was provided to assist the pilot in setting power. 

On the lower right side of the display was an armuncia- 
tor box which normally would have been used to display 
the current flight-director pitch mode, for example, alti- 
tude hold, glide-slope capture, or vertical-speed select. 
Because of a computer programming problem, the flight- 
director annunciator was not functional for this study. 

In addition to flight-director modes, the annunciator 
box was used to indicate which of the two visual-approach 
monitor modes, fixed depression (HI-LO) or delta-gamma 
(DEL-GAM), was being displayed. 

Finally, just above the mode annunciator box, the letters 
OM, MM, or IM flashed while passing over the outer, 
middle, and inner markers, respectively. 

Flight-director control laws and modes- The flight- 
director steering dot was driven by the output from the 
simulated flight-director used for the head-down panel. 
The control laws used were those for the Collins FD-109 
flight-director. One modification was made to add an 
airmass-referenced flightpath-angle term to the pitch steer- 
ing logic, thus making the flight-director a near-equivalent 
to current generation head-down flight-director logic. 

Conventional B-727/FD-109 flight-director modes were 
selected by the same switch used to control the panel- 
mounted flight-director. Lateral modes included heading 


select, VOR/localizer, and approach steering. Vertical 
modes included altitude hold, manual pitch, and glide- 
slope tracking. A go-around mode was also provided; it 
consisted of heading hold for lateral steering and a +15° 
pitch attitude in the vertical plane. 

Operating procedures- In precision approach opera- 
tions, use of the FD HUD was identical to the head-down 
FD. Heading select and altitude-hold or manual-pitch 
attitude select were used to maneuver and intercept final 
approach guidance. Localizer and glide-slope capture 
occurred automatically (if armed), and the pilot simply 
used the raw data and FD guidance in a conventional man- 
ner. Once the runway was in sight, the pilot continued to 
fly the display and either at or just prior to initiating the 
flare, “transitioned” to use of outside visual cues to com- 
plete the landing. 

Operating procedures for the nonprecision case were 
nearly identical until visual contact with the ground was 
acquired. Using the lateral steering in the VOR/LOC mode 
and the altitude-hold and manual-pitch attitude select 
functions, the pilot tracked the localizer and descended to 
minimum descent altitude (MDA) and leveled off. Upon 
visually acquiring the runway, the pilot could alternate 
between the flight-director and the fixed depression dis- 
plays. When the fixed depression line appeared to cross the 
threshold, the pilot initiated his descent and switched to 
the DEL-GAM mode. The pilot then “flew” the delta- 
gamma line to the desired touchdown point on the runway, 
initiating the flare and landing on the basis of external 
visual cues as in the precision approach. 

As mentioned earlier, airspeed reference was set by 
means of a knob and pointer on the airspeed indicator. The 
heading-select operation involved the use of the conven- 
tional heading bug on the panel-mounted horizontal- 
situation indicator. No other special operating procedures 
were required. Appendix B gives additional details. 


Flightpath HUD 

General description- The flightpath HUD used in this 
study was a conformal, or earth-referenced, display which 
under certain circumstances directly displayed the instan- 
taneous flightpath of the aircraft. Through a combination 
of scaled-raw-data navigation signals, the flightpath sym- 
bol, and ancillary aircraft status information, the display 
provided the information required to conduct terminal 
area maneuvers, intercept, final approach guidance, flare 
and landing or miss-approach operations. A brief descrip- 
tion of this display is given in the following paragraphs. 
Additional information may be found in Bray (1980) 
and appendix C. 
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Major display elements— The major elements of the 
flightpath HUD used in Phase III are shown in figure 3. The 
central circle with gull wings is the fli^tpath symbol. When 
established on the localizer, this symbol has full vertical and 
horizontal freedom and showed the instantaneous velocity 
vector of the aircraft. Because a B-727 was chosen for this 
study, it was assumed that an inertial platform was not 
available and, hence, the velocity vector was airmass ref- 
erenced. With an airmass-referenced flightpath symbol, it 
is not possible to have lateral freedom for the symbol until 
the aircraft is nearly established on this localizer. Then, if 
the inbound course of the localizer, the localizer error, and 
the heading of the aircraft are known, it is possible to com- 
pute and display the horizontal component of the velocity 
vector. The velocity vector is the primary controlled 
controlled element of this display, and the pilot’s task was 
to fly the flightpath symbol to the desired reference point. 

On the left wing of the flightpath symbol is an airspeed 
error tape. The tape rises above the wing for positive (fast) 
speed errors, and descends below the wing for negative 
(slow) speed errors. In addition, when the airspeed error is 
in excess of -5 or +10 knots, the airspeed-error tape flashes 
at a 4/sec rate. The reference speed was set by means of a 
knob and movable bug on the panel-mounted airspeed 
indicator. 

The artificial horizon and heading scales extend across 
the entire display field. Heading ticks are located atl5° 
intervals, and heading is marked at 10° intervals. This line 
overlays the real-world horizon at all times; that is, it is 
scaled 1:1 in both pitch and roll. A pitch ladder remains 
fixed relative to the horizon, and it is marked in 1° intervals 
to +10° and then in 5° intervals. 

For negative pitch attitudes and flighpath indications, 
there are major marks at -5° and -10°. In addition, there 
is an adjustable, fixed depression line which is set to the 
angle of the electronic glide-slope or to a desired visual, 
nonprecision flightpath angle. (This depression line was 
fixed at -3° for this study.) When glide-slope information 
is available, glide-slope error is displayed as the distance 
between this fixed depression line and the glide-slope sym- 
bol, which is the small circle with the two adjacent hori- 
zontal lines. For visual approaches, the fixed depression 
provides a reference flightpath to the point on the ground 
“under” the depression line. The artificial horizon line is 
broken for ±2.5° either side of the selected inbound course 
(localizer course), and a reference mark shows the selected 
course. Localizer error is displayed as the distance between 
the localizer symbol (the two vertical lines) and the selected 
course “bug” on the horizon scale. 

Both the glide-slope and localizer symbols are raw data. 
However, because they are amplified by appropriate fac- 


tors, they can be flown as if they were flight-director 
commands. When the flightpath symbol is flown to the 
localizer and glide-slope symbols, the aircraft will converge 
on the ILS localizer course and glidepath. 

The “greater than” symbol just to the left of the flight- 
path symbol is the acceleration or potential flightpath sym- 
bol. When read using the gull wings of the flightpath sym- 
bol as a reference, the symbol indicates whether the aircraft 
is accelerating (symbol above the wing) or decelerating 
(symbol below the wing) along the longitudinal flight- 
path. When read using the pitch scale as a reference, the 
symbol indicates the flightpath that can be maintained in 
constant-speed flight provided that current thrust and drag 
are maintained. In essence, the pilot “flies” this symbol by 
using the thrust levers to achieve the desired acceleration. 
If the pilot keeps the symbol adjacent to the gull wing on 
the velocity vector, he will maintain a nearly constant air- 
speed regardless of flightpath or configuration changes. 

Also on the display is a synthetic runway that overlays 
the real-world, and it can be set to disappear to indicate 
when decision height is reached. The small “V" symbol 
is the airplane reference symbol, and it displays aircraft 
attitude when read against the horizon and pitch ladder. 
Just above the airplane reference symbol is a distance from 
airport (DME) readout. The letters O, M, or I will flash 
just under the airplane reference symbol when it is passing 
the outer, middle, or inner markers, respectively. A man- 
ually adjustable MDA advisory line appears to come from 
the bottom of the display when the airplane is approach- 
ing MDA. The pilot can fly to the advisory line to capture 
and maintain a preselected MDA. The same symbol driven 
by radio altitude is used as a flare-advisory signal, and it 
can be used to assist in flaring the aircraft for the landing. 

Finally, indicated airspeed is displayed in digital format 
just to the left of the flight symbol, and altitude (radio 
altitude in this study) is displayed digitally on the right. 

Control laws- A complete description of the control 
laws which drive the various elements can be found in 
Bray (1980). 

Operating procedures- From the pilot’s point of view, 
operation of the flightpath HUD is straightforward. No 
mode switching is required; the presence or absence of 
valid localizer and glide-slope signals determines whether 
these symbols are present or not. For terminal-area maneu- 
vering, the pilot flies the flightpath symbol to the desired 
headings and altitudes, maintaining airspeed by using the 
potential flightpath symbol, airspeed, and airspeed error. 
Localizer tracking is effected by flying the flightpath sym- 
bol to the localizer symbol. If a normal intercept from 
below the glide slope is assumed, that symbol will move 
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down, and when it reaches the flightpath symbol it can be 
tracked to effect glide-slope capture. 

For nonprecision approaches, the locahzer is captured 
normally. At the outer marker, the flightpath symbol is 
“flown” down an approximate -5° flightpath until reach- 
ing MDA. (At the approach speeds of a B-727, a -5® 
flightpath is nearly a 1000 ft/min descent.) After visually 
acquiring the runway, the pilot maintains MDA until the 
fixed depression line crosses the threshold, and then he flies 
the flightpath symbol to the desired touchdown point. The 
flare advisory bar will appear to rise from the bottom of 
the display, and when it reaches the flightpath symbol the 
pilot flies the flightpath symbol so as to keep the flare 
advisory from rising above it. 


Altitude, m (ft) 

Angle of attack 

Temperature 

Center-of-gravity 

position 


Sea level to 1524 m 
(5000 ft) 

Not to exceed 25° 
in stall 
Standard day 
0.25 mean aerodynamic 
chord (MAC) 


The following control surfaces were simulated: elevator, 
aileron, flight spoiler, rudder, stabilizer, and flaps. In addi- 
tion, stick shaker, yaw damper, stabilizer trim, and wheel 
brakes were simulated. Ground spoilers and reverse thrust 
were not simulated. 


Simulator Apparatus 


Missed approaches involve flying a specific heading and 
maintaining an appropriate vertical flightpath. With go- 
around thrust set, the flightpath can be adjusted to main- 
tain the desired airspeed by flying the flightpath symbol to 
the potential flightpath marker; no mode switching is 
required. 

A declutter mode is available by operation of a finger 
switch on the control wheel. This allows the pilot to 
delete the localizer, glide slope, synthetic runway, and 
pitch and heading scale information in the final VMC 
portion of the approach if he so desires. Flightpath, 
potential flightpath, airspeed, and altitude remain, along 
with the flare advisory. 


DESCRIPTION OF PHASE III SIMULATION FACILITIES 

The equipment and facilities used in the Phase III experi- 
ment are described in the following paragraphs. 


Mathematical Model 


The basic mathematical model used represented a typical 
production configuration of the Boeing 727-200 airplane 
with JT8D-7 engines. This model had been purchased from 
the Boeing Aircraft Company for use in previous simula- 
tions. Configuration and flight conditions for this experi- 
ment were limited to the following: 


Flap position 
Gear 
Thrust 
Weight, lb 
Speed range 


15,25,30 
Up or down 
Idle to maximum 
140,000 

1 ‘g’ stall speed to flap 
placard speed 


The entire simulation program was carried out on the 
NASA/Ames Research Center’s Flight Simulator for 
Advanced Aircraft (FSAA) equipped with a Redifon TV 
model-board visual-display system. The FSAA is a general- 
purpose aircraft simulator that was designed for general 
piloted-aircraft simulations. The motion system is a six- 
degree-of-freedom device designed to impart rotational 
and large-amplitude translational movement to the cockpit. 
The basic motion capabilities of this simulator are pre- 
sented in table 1 . A photograph of the simulator area con- 
taining the motion system and cockpit is shown in figure 4. 

In the Redifon visual system, the visual image of the 
outside world is presented to the pilot by a color-television 
system whereby a camera looks at a model of a section 
of the earth’s surface. The camera is driven relative to 
the model in the same way that the aircraft moves rela- 
tive to the real-world, and a dynamic image of the outside 
world is created. A monitor placed before the pilot displays 
this scene through a collimating lens system that focuses 
the image at optical infinity. 

The area of primary concern on the terrain model board 
contains a conventional airport with runway dimensions of 
61 X 3048 m (200 X 8000 ft) and a Category II ILS light- 
ing system. Also, a hmited-visibility simulation device is 
incorporated in the television electronics; the simulation 
represents visibility conditions just under a low overcast, 
where objects on the . ground (approaching the horizon) 
become less distinct until at some elevation angle the con- 
trast is zero and no objects are visible. This capabihty can 
also be programmed as a function of distance to create 
variable visibility conditions. 


Cockpit Layout 

The cab of the FSAA was configured generally as a 
transport flight deck. Within the cockpit were mounted 
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B-747 flight deck seats for pilot and copilot as well as a 
third observer’s seat. The cab has an instrument panel and 
front, center, side, and overhead consoles upon which a 
variety of controls and instruments may be mounted. For 
this simulation, the cab was configured to be generally 
representative of a Boeing 727-200 aircraft. No attempt 
was made to duplicate such things as a flight-engineer’s 
station, communications equipment, warning systems, or 
other aircraft systems such as hydraulic, fuel, etc. The cock- 
pit layout is shown in figure 5. 

Both the captain and copilot stations had a complete 
set of fully functional instruments including airspeed 
indicator, radio and barometric altimeters, attitude director 
indicator (ADI), horizontal situation indicator (HSI), 
instantaneous vertical speed indicator (IVSI), and a clock. 
However, only the captain had a control column and could 
fly the aircraft. The center panel contained a full set of 
engine instruments, the flap indicators, and the landing- 
gear handle and indicating lights. The center console con- 
tained the throttles, spoiler handle, flap handle, and flight- 
director-mode select panel. 

Everyone in the cockpit wore headsets with live micro- 
phones so that all conversations could be monitored. In 
addition, the FSAA is equipped with a sound generator tliat 
reproduced the sounds generated by the noise of air flowing 
past the aircraft, the turbujet-engine-compressor whine and 
exhaust rumble, and the landing gear. 

It should be noted that one cockpit system which might 
have affected the way approaches were flown in this study 
was not simulated — the ground-proximity warning system. 

HUD Generation Display 

Since actual HUD hardware was not available, the sym- 
bology for the HUD was generated by a graphics display 
computer and displayed on a CRT. This image is reformed 
at optical infinity by two planoconvex lenses mounted 
before the pilot or copilot. A beamsplitter oriented at 45® 
between the lens and the monitors permits the pilot to view 
the HUD and the outside-visual-scene display simultane- 
ously. The actual HUD CRT is mounted above the cockpit 
and its optical axis is at 90® to the line of sight. A sche- 
matic view of the lenses and beamsplitter is shown in 
figure 6. 

The maximum field of view that could be provided was 
24® wide by 18® high; the limiting factor was the size of the 
CRT on which the HUD image was displayed. Also, to add 
realism, a mockup of a HUD combiner plate was mounted 
on the overhead panel with a hinge mechanism which 
allowed it to be either stowed out of sight or locked 
approximately 15 cm (6 in.) in front of the pilot’s eyes. 


The pilots were asked to adjust their seat position so that 
they viewed the display image through the combiner plate. 

Experimenter Station 

During the data-collection portion of the simulation, 
three experimenters were stationed in the control room. 
One experimenter acted as an air traffic controller and 
gave the pilot all necessary approach, landing, and go- 
around instructions. An X-Y plotter was set up to display 
aircraft position relative to the localizer so that the experi- 
menter could give vectors to the pilot. 

The second experimenter insured that all the initial 
conditions for each run were entered into the computer 
correctly and tliat all the data output was obtained after 
each run. The third experimenter monitored pilot com- 
mentary and recorded specific callouts and checkpoints. 


SUBJECT PILOT SELECTION 


Because the orientation of the Phase III study was 
operational, and because the basic objective to the experi- 
ment was to determine potential advantages and disadvan- 
tages of head-up displays in routine line operations, it was 
decided to use currently qualified line pilots as subjects for 
the study. Furthermore, since the simulator used for the 
study had only one fully operating pilot station, viz, the 
left side of the cockpit, it was decided to use only B-727 
line captains. To insure a broad representation of air car- 
riers, types of operations, regions of the country, and other 
factors, and aid of the air transport industry was enlisted 
in securing subject pilots. Carriers that wished to partici- 
pate were asked to forward a roster of line-qualified B-727 
captains to NASA project personnel. Candidates were 
selected from the roster by using a table of random num- 
bers, with restrictions placed on carriers and location 
(i.e., to the extent possible, it was desired to have no more 
than one pilot from a given airline or a given location). It 
was necessary to request two pilots from two carriers in 
order to have a sufficient number of pilots to conduct 
the study. 

The candidate subjects were contacted by the company, 
and, if they agreed to participate in the study, were sub- 
sequently contacted by NASA. NASA paid local expenses 
and travel expenses when necessary; the air carriers cov- 
ered for lost flight time. 

Thirteen subject pilots from nine airlines participated 
in the experiment. However, because of various difficul- 
ties, usable data were obtained from only ten pilots. 
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Table 2 lists the age, flight experience, and previous experi- 
ence with HUDs for each of the pilots. As shown in table 2, 
only two of the subjects had any prior experience with 
HUDs, both while in military service. Only one of the two 
had actual flight experience with a HUD (in an A-7 air- 
craft); the other had flown a HUD installation in a military 
simulator (EA-6B). 


SUBJECT-PILOT SCHEDULING AND TRAINING 

Pilot training for the Phase III study was conducted by 
using three major instructional techniques. Subject pilots 
were initially given a training handbook to review. They 
were given detailed briefings on the HUD, and finally, 
given hands-on training and practice in the simulator. 

Scheduling 

Subject pilots were scheduled in pairs for three-day 
periods during which ail training and experimental data 
runs were completed. Subjects were asked to arrive in the 
San Francisco Area during the afternoon or evening prior 
to their first full day at Ames. Upon checking into their 
hotel, they were given a ring binder which contained a 
background and experience questionnaire, a brief descrip- 
tion of the study, and a training handbook for either the 
FD HUD or the FP HUD. The pilots were asked to review 
this material before reporting to Ames the following 
morning. 

Training Handbook 

Each training handbook contained five sections, which 
are described briefly as follows (complete handbooks are 
contained in appendices B and C): 

Introduction to head-up displays- This section con- 
tained a brief description of major issues pertaining to head- 
up displays. It also provided a brief description of the scope 
and objectives of the Phase III study, the role of the line 
pilot as a test subject, and a breakdown of the training and 
data-collection schedule. 

HUD description and review— Sections 2 and 3 of the 
HUD training handbook contained detailed operational 
descriptions of the HUD and a functional review of display 
elements. Each of the display elements was described and 
its function was discussed. Generally, the material was pre- 
sented from the pilot’s point of view, that is, how the phot 
should use each display element when flying. 

Analysis of sample problems- In order to maximize 
pilot understanding of the various display modes and the 


interpretation of symbol meanings, each handbook con- 
tained a section which presented the pilot with a series of 
sample “problems.” Each problem provided a set of initial 
conditions (e.g., reference airspeed, attitude, visibility, 
etc.), and also a photograph of the HUD. The pilot was 
asked to answer a series of multiple-choice questions 
about his flightpath, acceleration, attitude, etc., using the 
initial-condition data and the photograph of the HUD. The 
pilot was also asked to analyze the situation shown and to 
make recommendations for corrective action. Answers to 
these problems were used by the instructor to provide a 
basis for discussion during classroom training. 

Crew procedures- Section 5 of the training handbook 
contained the crew procedures used for the Phase III eval- 
uation. Pilot and copilot duties and callouts were described 
in detail in this section. These procedures were adapted 
from one operator’s B-727 Aircraft Operating Manual. One 
of the primary considerations which led to the use of this 
set of procedures was that many of the standard callouts 
(e.g., at outer-marker passage) are made by the pilot 
flying. 

Copilot duties for all training and data runs were han- 
dled by the project instructor or by one of two NASA 
copilot/observers, A detailed description of pilot duties and 
callouts may be found at the end of appendix B, 

HUD classroom instruction— Classroom instruction was 
conducted in a pilot’s “ready room” located near the simu- 
lator. Instruction included lectures illustrated by slides, 
interactive analysis of problem situations contained in the 
handbook, and dynamic demonstrations using video tapes. 
In this manner, the subject pilot was taken from a static 
learning situation to a dynamic situation. Subjects were 
encouraged to ask questions about any aspect of the display 
or the pilot procedures to be employed during the study. 
Pilots were rehearsed in crew procedures by viewing video 
tapes of actual training flights and making the necessary 
callouts. During this period the instructor sat with the pilot 
and functioned as a cooperative copOot; he made callouts, 
prompted the pilot, and recommended appropriate pilot 
responses to display information. 

FSAA familiarization and training- After completing 
the structured classroom training, subject pilots went, one 
at a time, into the FSAA for their first simulator training. 

The initial training session was designed to familiarize 
the subjects with the FSAA cab, instruments, controls, and 
operating procedures. The HUD was not turned on for this 
preliminary training. Following a short incab briefing, a 
series of straight-in approaches were flown, first without 
motion, and then with the motion system turned on. Pre- 
liminary emphasis was upon the use of motion and visual 
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cues to effect smooth approach and landing operations, and 
no attempt was made to integrate callouts and other flight- 
crew procedures. Between 10 and 12 landings were made 
during this period, which required approximately 40 min 
to complete. Following a break, during which the second 
subject pilot was given his FSAA familiarization training, 
the pilot returned to the cab for his second head-down (no 
HUD) training session. 

The emphasis in the second training period was on the 
use of the cockpit instrumentation, especially the head- 
down flight director, and on the normal crew duties and 
callouts used for the study. Approximately 15 approaches, 
including ILS and localizer front-course approaches, were 
flown during the second period, which took about an hour. 
In the latter stages of this training, there were encounters 
with various visibilities, ceilings, and wind conditions, 
including some wind-shear conditions. 

The instructor pOot attempted to provide sufficient 
training and instruction to bring all subject pilots to equiva- 
lent, satisfactory levels of proficiency before proceeding to 
the HUD training. 

HUD Training 

Following another break, during which the second sub- 
ject pilot received his second head-down training session, 
the subject returned to the cab for his first HUD training 
session. This series of training approaches was essentially 
the same as the series used for the second head-down, no- 
HUD training session. 

The HUD training sessions started with a short introduc- 
tory period in which the pilot flew the aircraft in straight 
and level flight, then in gentle turns, climbs, descents, and 
finally through configuration and speed changes. Then a 
series of ILS approaches were flown, initially straight in, 
with the aircraft already configured and established on the 
ILS ‘and onspeed; the approaches became increasingly more 
difficult and culminated in an approach which required 
intercept of both localizer and glide slope, effecting config- 
uration changes, and slowing to approach speed with some 
crosswind and turbulence. Immediately after completing 
the series of ILS approaches, the pilot flew an equivalent 
series of nonprecision (localizer front course) approaches. 
This first HUD training session required approximately 45 
to 50 min to complete. 

Following a third break, the subject returned to the 
FSAA for his final HUD training period. Emphasis during 
this time was on the callouts and approach procedures and 
continued practice using the HUD during simulated 
terminal-area maneuvering, intercept of the final approach 
guidance, and flying the approach to a landing, or in some 


cases, a missed approach. This session, also approximately 
50 min long, ended with a series of straight-in approaches 
flown through wind shears similar to those used for the last 
head-down training session. 

Generally, the availabOity of the simulator was such 
that all head-down and HUD training and practice sessions 
could be completed for one subject pilot, and all except 
the second HUD training session for the second pilot during 
the first day. The second pilot’s HUD training was com- 
pleted during the first simulator period of the next day, and 
then data collection was begun for both pilots. All the data 
collections for the HUD approaches and half the no-HUD 
data runs were completed for each subject, and then train- 
ing was begun on the second HUD. This training program 
was identical to the HUD training described previously, 
including the training handbook, classroom and lecture 
training, and the simulator training and practice. 

Because the basic comparisons made in this study were 
between performance with and without the HUDs, every 
attempt was made in the training program to provide com- 
parable training and familiarization on both head-up dis- 
plays and on the basic FSAA instrument panel. Because of 
differing individual requirements, it was neither possible 
nor desirable to provide completed identical training. It is 
believed, however, that reasonably comparable levels of 
proficiency were achieved with this training program. 


DATA SCENARIOS AND EXPERIMENTAL DESIGN 

Selection of an appropriate approach and experimental 
design was one of the most difficult tasks that faced the 
Phase III project team. There are myriad factors which, 
ideally, ought to be systematically explored. As in any 
other situation involving limited resources, it was necessary 
to compromise with regard to the Phase III experimental 
design, and a brief review of some of the factors considered 
is given in the following paragraphs. 

Although it was recognized that there may be some 
potential benefits of head-up displays in phases of flight 
other than the final approach and landing, the primary 
design objective was to provide better vertical guidance 
during visually referenced approach and landing opera- 
tions. Accordingly, the experimental approach used for this 
study focused upon the straight-in final-approach seg- 
ment, with particular emphasis given to the latter portion 
of the approach, flare, and landing operations. 

Since vertical guidance was the major area of concern, 
factors which could potentially interfere with the pilot’s 
ability to perceive or properly utilize the visual information 
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required to effect a stabilized final approach were candi- 
dates for inclusion as independent variables in an experi- 
mental evaluation of HUDs. Included are the many environ- 
mental factors that might affect visual perception, for 
example, low visibilities, low ceilings, precipitation, runway 
lighting, runway slope, terrain slope and lighting, and sun 
angle, including day versus night. Other environmental 
variables affect the stability of the flightpath, for example, 
crosswinds, turbulence, and wind shear. Similarly, opera- 
tional variables can affect both the acquisition and utiliza- 
tion of visual information by the pilot, for example, dis- 
tractions caused by inter- or intra-cockpit communica- 
tions and the stability of the flightpath, as, for example, an 
ATC request to “maintain 180 knots to the outer marker.” 
Other factors may also be of interest, including pUot age 
and experience, pilot training received in the use of HUDs, 
flight crew operating procedures, and similar factors. 
Because time and resource limitations precluded a system- 
atic review of all possible variables, it was necessary to iden- 
tify those that are of most significance and then design an 
experiment that permitted a rigorous evaluation of their 
effects. If time and resources permit, it is desirable to 
explore as many other factors as possible so that some data 
may be obtained that provide at least a first-order assess- 
ment of the significance of these factors for operations with 
head-up displays. The experimental design used in the 
experiment reflects this rationale. A brief overview of 
the experimental design used in this study follows; and 
appendix D gives a complete technical discussion of the 
experimental design. 

Essentially the experiment had two levels: (a) the core 
experiment in which all subjects encountered all indepen- 
dent variables; and (b) a second-order experiment in which 
a given subject encountered a Hmited subset of the 
independent variables. 


The Core Experiment 

The main factor in the experiment was display type: 
FD HUD, FP HUD, and NO HUD; the latter providing the 
baseline data against which performance with the head-up 
display was evaluated. 

Independent variables in the core experiment were: 
(a) winds and turbulence, and (b) ceiling and visibility. Two 
basic ceiling and visibility conditions were selected: (1) a 
situation in which the ceding and visibility were well above 
the appropriate minima for the type of approach flown; 
and (2) a situation in which the ceding and visibdity were 
very near the appropriate minima. Three basic wind condi- 
tions were chosen for the core experiment: (a) a light head- 
wind with low turbulence; (b) a moderate quartering tad- 
wind with an intermediate level of turbulence; and (c) a 


moderate-to-strong crosswind with a high level of tur- 
bulence. Specific values for each variable are shown in 
tables 3 and 4. 

It should be noted that the wind data in table 4 are the 
nominal winds at 304 m (1000 ft) above ground level 
(AGL). The wind model used in the FSAA facdity incor- 
porates an exponential decay of speed as a function of 
altitude. Thus, wind speed at the runway surface was 
approximately half the nominal wind shown in table 4. 

Because vertical guidance for precision and nonpre- 
cision approaches, is, by definition, different, it was nec- 
essary to evaluate these separately. Accordingly, the core 
experiment above was conducted twice: once for ILS 
approaches and once for localizer front-course approaches. 

In summary, the core experiment consisted of three 
display types (FD HUD, FP HUD, and NO HUD); two 
ceiling and visibility conditions (near minima and weU 
above minima); and three wind conditions (headwind, 
quartering tailwind, and crosswind). The core was con- 
ducted for each of two levels of approaches (precision and 
nonprecision). Thus, each subject pilot flew 36 approaches 
during Phase III data collection. Table 5 is a summary of 
the core experimental design. 

Secondary Experiment 

The design of the core experiment was a complete fac- 
toral design that not only offered several important advan- 
tages for evaluating the rehabihty and significance of the 
data, but it also severely restricted the number and range of 
variables that could be studied. In order to increase the 
utility of the Phase III experiment and yet not decrease its 
analytic rigor, a second-order, or fractionally repHcated, 
experiment was superimposed on the core. This process 
allowed the experimenter to increase the scope and range 
of observations. Although the analytic or statistical rigor 
inherent in the core experiment is not available for these 
factors, this technique did permit an approximate evalua- 
tion of the effect of these variables. 

Two kinds of second-order variables were used: (a) air 
traffic control handling; and (b) miscellaneous wind, visi- 
bility, and operational factors as described below. 

ATC Handling 

Although the primary focus of this investigation was 
upon the final approach, flare, and landing, it was recog- 
nized that performance during these phases of flight can be 
affected by preceding events. Furthermore, the HUD design 
guidelines adopted for this study required that the HUD be 
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capable of use during terminal-area maneuvering and inter- 
cept of the final-approach guidance in addition to the latter 
stages of an approach. Accordingly, all approaches were 
begun from a base leg position approximately 12 flying 
miles from the airport. Three different starting altitudes 
were used: (a) 457.2 m (1500 ft), which is the initial 
approach altitude; (b) 762 m (2500 ft); and (c) 1219.2 m 
(4000 ft). These three starting altitudes formed the basis 
for the three ATC handling conditions; each scenario 
required a different sequence of heading and altitude com- 
mands from ATC. Because this ATC handling variable was 
used, it was possible to sample performance under a variety 
of workload and time-stress conditions. The 457.2 m 
(1500 ft) initial altitude involved no altitude changes (nor 
associated ATC communications) prior to crossing the final 
approach fix; the 1219.2 m (4000 ft) initial altitude 
required altitude changes and associated communications in 
addition to the heading, configuration, and speed changes 
required for all approaches. Because of the distance from 
the airport (about nine straight-line miles), the 1219.2 m 
(4000 ft) initial altitude resulted in a relatively high pilot 
workload during this stage of the approach. 

Miscellaneous Factors 

In addition to varying pilot workload by the use of ATC 
handling, four other factors were explored in the second- 
level experiment: (1) lower-than-reported visibility at the 
missed-approach point; (2) variable-visibility conditions, 
which involved intermittent visual ground contact; 

(3) encounter with a 15 knot decreasing wind condition 
between 53.3 m (175 ft) and 22.9 m (75 ft) AGL; and 

(4) the presence of a partial runway obstruction in the 
touchdown zone in the form of a scale-model aircraft situ- 
ated with its forward fuselage extending onto the runway 
from an intersecting taxiway. This latter factor was 
included in order to gather more information on the per- 
ceptual switching issue described earlier, and it was an 
extension of some work conducted during one of the 
Phase II studies (see Fischer, Haines, and Price, 1980). 

For any given subject pilot, six out of the 36 total 
approaches involved an encounter with one of the four 
factors described previously; they are referred to as 
“anomalies” in appendix D. The specific anomaly and the 
sequence in which it appeared was assigned on a psuedo- 
random basis. The exact number of observations for each of 
these factors is given in the Results section of this report. 

Counterbalancing and Randomization 

Whenever appropriate, randomization and counter- 
balancing were accomplished to prevent systematic biases 


from appearing in the data. Factors which were counter- 
balanced and/or randomized included: (a) display orders 
for both initial training and data collection; (b) order of 
core experimental conditions; and (c) selection and order of 
second-order factors (ATC handling and “anomalies”). In 
addition, other factors, including whether the initial posi- 
tion of the aircraft was on a right base leg or a left base leg, 
and the wind direction relative to the localizer course 
(e.g., left crosswind or right crosswind), were randomized 
and balanced throughout the experiment. 

Data Scenarios 

All approach scenarios were begun from either a right or 
left base-leg position approximately 12 miles from the air- 
port. Initial altitude was either 457.2, 762, or 1219.2 m 
(1500, 2500, or 4000 ft) AGL (also mean sea level (MSL) 
since the simulated airport was at sea level). The landing 
gear was up, flaps were positioned at 15°, and the initial 
airspeed was 160 knots. 

The subject pilot always occupied the left seat, and one 
of two NASA copilot/observers occupied the right seat. The 
copilot/observer had a clipboard on which the appropriate 
initial conditions and other relevant data for each approach 
were printed (appendix E). The copilot/observer used a 
brief checklist to insure that all aircraft controls and instru- 
ments were properly set prior to initiating a run. 

A packet of landing data cards, which contained the 
approach type, winds, weather, aircraft gross weight, 
reference speed, and go-around thrust settings, was used to 
brief the pilot and copilot/observer prior to each approach. 
No approach charts were used because all approaches were 
to the same runway (09), and the decision height (DH) and 
minimum descent altitude (MDA) were always 61 m 
(200 ft) and 137.2 m (450 ft), respectively. 

After the cockpit was set up and the crew briefed, the 
approach was commenced according to standard FSAA 
operating protocol. As soon as the simulator was released, 
an “air traffic controller” located at the FSAA console 
established communications with the simulator and issued 
ATC instructions in accordance with a standardized script 
(see appendix F). 

Subject pilots were told to handle the aircraft in the 
same way they would if they were operating “on the line.” 
Thus, for example, if they wanted a lower altitude, they 
were encouraged to ask for it. Therefore, occasional devia- 
tions from the ATC script occurred but every attempt was 
made to keep these deviations minor. 

Each scenario was flown by using the standard crew 
procedures described previously. Thus, the copilot/observer 
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handled all ATC communications, read the final-descent 
checklist, and made the assigned callouts. The pilot-in- 
command flew the aircraft, commanded configuration 
changes, checklists, and special callouts (if he so desired), 
and made his required callouts. 

All approaches terminated either in a landing, in 
which case the simulator was reset for the next approach, 
or in a missed approach, in which case the simulator 
was reset when the aircraft was stabilized in the missed- 
approach maneuver. 

For any given HUD, data collection was usually accom- 
plished in two simulation periods per subject pilot. This 
procedure required approximately nine approaches per 
period so that during the two periods 18 approaches were 
flown. Twelve of these were flown using the appropriate 
HUD and six were NO-HUD baseline-data approaches. 
Approximately 1-1/2 hr were required to complete one 
simulator period. 


DATA COLLECTION AND PERFORMANCE MEASURES 


Three broad categories of data were collected during the 
Phase III experiment: (a) objective, simulator-based perfor- 
mance measures; (b) observer data from the copilot/ 
observer and the observer located at the FSAA operations 
console; and (c) subjective data from the subject pilots in 
the form of general comments and responses to question- 
naires and rating scales. Each of these is described below in 
the following paragraphs. 

Objective Performance Measures 

Simulation performance data were collected in three 
different formats: (a) on magnetic tape; (b) on summary 
printouts following each approach; and (c) on analog strip- 
chart recorders. 

Because the set of “most relevant” performance mea- 
sures changes as a function of phase of flight, each 
approach was divided into five segments, as described in the 
following paragraphs. 

1. Intercept segment — This segment began at the initial 
position of the aircraft and ended when the aircraft crossed 
the final approach fix (FAF). Because of the dynamic 
nature of operations in the intercept segment, it is 
extremely difficult to develop suitable, objective perfor- 
mance measures. Accordingly, only observer and pilot- 
comment data were used during this phase of flight. 


2. Approach segment — This segment began one half 
mile inside the final approach fix and ended at a point that 
was two miles from the glide-slope intercept at the runway. 
Under ideal circumstances, operation in this segment should 
be stabilized, thus providing useful objective performance 
measures (e.g., airspeed error, glide-slope error, localizer 
error, etc.). 

3. Decision segment — This segment began at the end of 
the approach segment and continued to a point approxi- 
mately 1000 ft short of the runway threshold. During an 
ideal ILS approach, aircraft performance will again be 
stabilized. Nonprecision approaches are generally not 
stabilized during this segment, and therefore, are much 
more difficult to describe and measure objectively. 

4. Flare segment — This segment was that part of the 
approach between the end of the decision segment and a 
15 ft radar altitude. Performance during this segment is 
likely to be relatively unstable because the flare is initiated 
sometime during the segment. Other changes (e.g., airspeed 
decay), are also likely during this segment. 

5. Landing segment — Tliis segment terminated at touch- 
down. 

Because it is possible for a missed approach to occur 
at any point in an approach, it was not possible to define a 
missed-approach segment in tlie same sense as the other 
segments are defined. Furthermore, when a missed 
approach did occur, any subsequent segments, usually the 
flare and landing segments, were missed. Because the missed 
approach is another dynamic situation the performance 
during a missed-approach segment has to be described in 
qualitative terms. 

The actual parameters recorded during an approach were 
a function of the approach segment. These parameters are 
discussed in detail in the Results section of tliis report, but 
generally those aircraft-state variables that most directly 
reflected the pilot’s ability to control airspeed, vertical 
fliglitpath, and lateral flightpath were recorded at all times. 
Two kinds of data were recorded: 

1. Continuous measures — For those segments and vari- 
ables for which reasonably stabilized performance could be 
expected, several continuous-performance measures were 
recorded. For example, during the approach segment, glide- 
slope tracking should be relatively stable and, therefore, the 
root-mean-square (nns) glide-slope error was recorded for 
this segment. Similarly, airspeed should be reasonably 
stabilized during this segment. However, since target 
airspeed is, in part, a matter of pilot discretion, rms air- 
speed error is probably not a good measure, but rms air- 
speed deviation is. The selection of all continuous 
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performance measures discussed in the Results section was 
based on this kind of rationale. 

2. Window measures - Window measures are essentially 
^‘snapshots'’ of aircraft-state variables taken at some speci- 
fied, discrete point in time or space. Selection and specifica- 
tion of window measures were based on rationale similar to 
that used for the continuous measures. For example, when 
the aircraft crosses the threshold, several variables can 
reflect pilot and aircraft performance, and they are highly 
correlated witli subsequent events. Specifically, altitude and 
lateral position determine whetlier the aircraft is “in the 
slot,” and sink rate and airspeed control are critical during 
this phase of fliglit. 

Window measures were taken at various points through- 
out the approach, including the beginning and end of each 
approach segment, the passage over each marker beacon, 
the tlireshold, and at touchdown. The specific measures 
used are described in the Results section. 


Observer Data 

The copilot/observer and the observer at the FSAA con- 
sole recorded significant observations during or at the end 
of each approach. These observations were augmented by 
using a video recording of the pilot’s visual scene; cockpit 
and ATC communications were recorded on the audio track 
of the video tape. 

Generally these observers recorded operational blunders 
committed by the pilot as, for example, pilot failure to 
call for the final-descent checklist. These data were useful 
for qualitative analyses of pilot performance, and they fre- 
quently helped to lend insight in interpreting performance 
differences seen in the objective data. 


Subjective Data 

Questionnaire and rating scale data were obtained from 
all subject pilots at various times during the experiment. 
After they completed the approaches for each HUD, pilots 
were given a questionnaire and rating scale which were 
directed toward specific design and operational character- 
istics of that HUD. The questionnaires for the two HUDs 
were identical. Similarly, when a pilot had completed all 
data runs, other questionnaires and rating data were 
obtained on the training program, crew procedures, call- 
outs, simulator facilities, scenarios, and other features of 
the experiment. 

Subject pilots were further debriefed after they had 
completed all questionnaires. Significant comments and 


observations were recorded and they are discussed in the 
following paragraphs. 

RESULTS 

This section contains a summary of the results obtained 
in the Phase III experiment. Most of the quantitative data 
presented have been extracted from the complete set of 
analyses performed by the Control Analysis Corporation, 
whose report is presented in appendix D. The report 
presents the mean, standard deviation, maximum and mini- 
mum value for every measure for each of the three display 
conditions. Forty-one different variables were analyzed by 
means of a series of one-way analysis of variance (ANOV) 
tests. Twenty-two of these resulted in F ratios which were 
significant at or beyond the 0.05 level of confidence. As 
an aid to understanding the engineering impact of the data, 
histograms are presented. Note that separate analyses were 
performed for ILS and nonprecision approaches. 

The results will be discussed by flight segment as pre- 
viously described in the Data Collection and Performance 
Measures section of this report. 

Intercept Segment Results 

This segment began at the start of the run and ended at 
the outer marker. Because of the dynamic nature of opera- 
tions in this segment due to ATC vectors and configuration 
changes, it is difficult to specify suitable objective perfor- 
mance measures. While five variables were identified, most 
of the useful data in this segment are from pilot or observer 
comments. The performance data is summarized in table 6. 
Only two of these measures showed statistically significant 
differences: (a) outer marker crossing altitude for ILS 
approaches (OMALT); and (b) airspeed error for nonpreci- 
sion approaches (OMVQVR), However, there is some 
practical significance to the other data. The data for the 
aircraft lateral displacement from the runway centerline 
at the outer marker (OMYCG) shows consistent perfor- 
mance for all approaches head down but larger scatter for 
both HUDs as well as some large maximum excursions 
especially for the FP HUD. Table 7 contains a summary 
of the runs in which there was a lateral displacement equal 
to or greater than one dot localizer error at the outer 
marker. In all cases, the wind condition was either the 
quartering tailwind or the crosswind case. On the base leg 
and during radar vectors to the final intercept, the wind was 
from behind and tended to push the airplane away from the 
localizer during the actual intercept segment. For the flight 
director cases, either head up or head down, the director 
control laws would compensate for the effect of wind and 
command larger pilot inputs. For the flightpath HUD, since 
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there is no command information, the pilot is compensating 
for wind himself. Any failure to recognize the wind condi- 
tion or delay in starting the localizer intercept maneuver 
will result in an overshoot. Half of the subjects commented 
that they had varying degrees of trouble with the fliglitpath 
HUD interpreting what information the course line and 
localizer line was giving them. Also, during the steeper 
descents required for the 4000 ft starting altitude, the 
heading information would disappear from the HUD field 
of view causing some confusion during the intercept 
maneuver. 

Approach Segment Results 

This segment began one half mile inside the final 
approach fix and ended at a point that was two miles from 
the glide-slope intercept at the runway. This means that all 
approach data was for IFR portions of each run only. Gen- 
erally, operation in this segment should be more stabilized 
since configuration changes would normally have been 
completed and final approach speed established. Thus, 
more useful objective performance measures are available 
(e.g., airspeed error, glide-slope error, localizer error, etc.). 
Seven variables were selected for analysis in this segment. 
Their means, standard deviations, and maximum and 
minimum values are summarized in table 8. Note that the 
rms glide-slope error (AGS) was measured for the non- 
precision approaches even thougli the pilot was not given 
glide-slope information. This was done to allow a com- 
parison of the performance with the three displays against 
a known reference. 

For ILS approaches, five variables displayed significant 
differences as a function of display condition. These vari- 
ables were rms localizer error (ALOC), rms glide-slope 
error, and the maximum, mean, and rms deviations of sink 
rate (AHDOTMAX, AHDOTM, and AHDOTD), respec- 
tively. For the nonprecision approaches, ALOC and 
AHDOTM differed significantly. 

As would be expected, the ALOC data was consis- 
tent between ILS and nonprecision approaches since the 
pilot’s lateral tracking task was the same. These data are 
shown in figure 7. While the performance with both the FD 
HUD and FP HUD was better than the NO HUD case, the 
actual amount of improvement was quite small since 
performance with the conventional instruments was already 
very good. Maximum and minimum values were compar- 
able with the exception of the FD HUD in the ILS 
approach. This maximum point occurred during a run 
where the pilot had overshot the localizer by a considerable 
amount during the intercept from a 4000 ft starting alti- 
tude and was recapturing the localizer. Strip chart record- 
ings of this approach showed good pilot performance dur- 
ing the recapture maneuver. 


Similar results are seen in the glide-slope tracking data 
in figure 8. Again performance with both HUDs is better 
than with the conventional instruments but the absolute 
amount of improvement is small since overall performance 
with the standard panel display was excellent. The maxi- 
mum values reached were comparable and, again, usually 
occurred during the approaches initiated from the 4000 ft 
starting altitude. 

The airspeed performance data, AEASM and AEASD, 
wliile not statistically significant are very interesting in a 
practical sense. The remarkable consistency of these data 
for all displays across all test conditions is noteworthy. The 
digital readout of airspeed and the airspeed error worm in 
both displays was quite different from the typical needle 
presentation on an airspeed indicator, yet performance was 
slightly better with the two HUDs. 

The remaining variables, AHDOTMAX, AHDOTM, and 
AHDOTD are shown in figures 9, 10, and 11 for both ILS 
and NPA. It should be noted that all of these variables 
are direct measures of vertical flightpath control. For the 
ILS approaches, the data followed the same pattern seen in 
tlie glide-slope and localizer tracking data, that is, more 
accuracy and precision for the HUDs than the instrument 
panel. For the NPA cases, there is a remarkable similarity 
between the conventional panel and the FD HUD data and, 
in general, an improvement in performance with the FD 
HUD. 

Decision Segment 

This segment covered the approaches from approxi- 
mately two miles out to a point 1000 ft short of the run- 
way threshold. It was witliin this segment that the pilot had 
to make his decision to land or go-around. Table 9 contains 
a summary of the total number of approaches and go- 
arounds for each category. The go-arounds on approaches 
with an anomaly condition were expected since the anoma- 
lies were designed to create a potential go-around situation. 
For all other approaches, less than 3% resulted in 
go-arounds. In fact, these seven go-arounds were all during 
nonprecision approaches and were distributed between NO 
HUD and FD HUD runs. Analysis of these seven runs 
reveals that most of the go-arounds were made after a deci- 
sion to land had been made at MDA, Also, they were all 
either the crosswind or quartering tailwind cases. One 
factor that may have led to the go-arounds in the NO HUD 
case was a general lack of experience using a flight director 
for nonprecison approaches. Comments to this effect were 
made on the Supplemental Questionnaire. 

For the FD HUD, some slight confusion existed in how 
to use the display in the final stages of the approach. The 
DELTA-GAMMA and HI-LO lines were offset laterally 
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from the runway during the tailwind or crosswind cases and 
consequently some mental extrapolation had to be made by 
the pilot to assess his vertical path. If the pilot elected not 
to use the DELTA-GAMMA or HI-LO lines, there was 
some problem in ignoring the flight director command as 
the flare segment was approached, since there was no 
flare command guidance provided. These problems were 
not observed with the FP HUD since the pilot technique 
required was essentially the same for both ILS and non- 
precision approaches. 

The most useful data in this decision segment were the 
middle marker “snapshot” data. The four most interesting 
parameters are presented in table 10. The altitude 
(MMALT) and lateral displacement from the runway 
centerline (MMTCG) are plotted in figures 12 through 17 
to depict the overall distribution at the middle marker 
“window.” For the ILS approaches it is very clear that 
performance with either HUD was more accurate and pre- 
cise than with the conventional head down instrument 
presentation. Of the two HUDs, the FP HUD performance 
was the best. 

For the nonprecision approaches, the conventional 
panel and FD HUD data show large scatter at the 
“window.” In fact, the FD HUD performance is not as 
precise or accurate as the performance head down. Again, 
performance with the FP HUD was clearly better. 

The sink rate data at the middle marker (MMHDOT) are 
presented graphically in figure 18. The same general trend 
is seen again, that is, improved performance with either 
HUD over conventional instruments. Since sink rate is a 
direct measure of vertical flightpath control, it is not 
surprising that the FP HUD provided the best performance. 


Flare Segment 

The only consistent data taken in the flare segment are 
the parameters measured at the runway threshold window. 
The four most useful parameters are tabulated in table 1 1 . 
Again, the altitude (FALT) and lateral displacement from 
the runway centerline (FYCG) are plotted in Figures 19 
and 20 to give a picture of the overall aircraft position for 
all cases at what is essentially the start of the flare. It is 
interesting to compare these figures with the middle marker 
window data. The same pattern of improved precision and 
accuracy with the FP HUD is stiU very apparent. However, 
the performance with the FD HUD does not show any 
improvement and actually may be slightly worse. These 
data seem to support the observation that the use of this 
display became somewhat confusing to some subjects in the 
last stages of the approach and landing. 


Landing Segment 

Vertical velocity at touchdown (LMAXHDOT), airspeed 
at touchdown (LMAXVEQ), lateral displacement from run- 
way centerline (LYCG) and distance down the runway at 
touchdown (LXCG) were all measured and are summarized 
in table 12. Figures 21 and 22 are scatter plots of the 
landing footprints for ILS and nonprecision approaches. 
The distribution pattern follows that seen at the threshold. 
While landing data for the FP HUD showed the most 
consistent performance with the least scatter, it must be 
noted that overall performance across all displays for aU 
conditions was quite good. The average vertical velo- 
city at touchdown for over 300 landings was -3.1 ft/sec 
with no “crashes” occurring. It is interesting that the 
shortest, longest, and hardest landings all occurred on NO 
HUD runs. 


Anomalies 

As described previously, one in six approaches was to 
involve an encounter with one of four “anomalies.” Due to 
simulation problems, somewhat less than this was actually 
obtained. Because of the relatively low numbers of observa- 
tions per case for each of the three display conditions, it is 
not possible to apply rigorous analytical techniques to these 
data; they were included to expand the range and scope of 
the general observations regarding head-up displays in civil 
transport operations. Table 13 summarizes the number of 
landings and missed approaches for each of the four anom- 
alies as a function of display type. 

For the wind shear encounters, there were only two go- 
arounds out of 12 approaches, and both of these were with 
the FD HUD. For the other two displays, aU seven encoun- 
ters ended with a landing. In fact, the actual performance 
for all landings following a shear encounter was quite good. 
While the general level of the shear could be considered 
moderate, it appeared that the pilots were able to recognize 
and cope with the shear adequately. In response to the 
questionnaire, pilots indicated a preference for both dis- 
plays over conventional instruments for wind shear 
detection. 

For both the variable visibility and minimum visibility 
cases, the results are not very conclusive. In the “scud” 
case, at least one missed approach was executed with each 
display, with most of them occurring during nonprecision 
approaches. For the minimum ceiling cases, out of seven 
approaches, one missed approach was executed and that 
was with the FD HUD. 

For the runway obstruction anomaly, all 13 approaches 
ended in a missed approach. A summary of the visibility 



and ceiling conditions as well as missed approach informa- 
tion for these runs is given in table 14. Eight of the pilots 
felt that the FP HUD was superior to conventional head- 
down approaches in coping with runway obstructions. In 
general, pilots commented that because they were focussed 
at infinity and already looking out at the runway environ- 
ment, they felt that earlier detection of obstructions 
would occur. However, several comments were made about 
symbology cluttering the view and attention to the FD 
HUD command dot distracting the pilot from vievdng 
the runway. 


Questionnaires, Rating Scales, and Pilot and 
Observer Comments 

During the course of the study, subjects completed 11 
questionnaires. In addition, a post-study questionnaire was 
mailed to all subjects soliciting additional information 
about previous flying experience with cross-pointer dis- 
plays and the amount of training provided during Phase III. 
Both open-ended questions and rating scales were incor- 
porated in the battery. 

Wherever possible, quantitative data derived from pilot 
ratings and pilot responses were subjected to appropriate 
statistical tests and measures. All pilot comments were 
reviewed for indications of possible trends or useful 
insights. 


Pilot Ratings of Head-Up Displays 

After completing simulator data collection runs with one 
of the HUDs, each pilot filled out a 13 part questionnaire 
evaluating that particular display (see appendix G). The 
same questionnaire was used for both display types. Five 
of the parts were structured as rating scales where pilots 
were asked to compare a particular aspect, or operational 
feature, of the HUD in^ question with the conventional 
head-down display. In each case the scale values ran from a 
-10 (worse than) to a +10 (better than). 

Three of the questions were structured to require 
or “no” responses; the other three questions were open- 
ended and asked for comments that would explain or 
amplify, the responses given to the rating scales. 

Rating scales were analyzed by conducting a one-sample 
“t” test on a question-by-question basis. The foUovdng 
premises were involved: 

1. A rating near or at the midpoint of the scale was 
equivalent to a judgment of “no difference” between HUD 
and head down. 


2. On the basis of pure chance, subjects would tend to 
scatter their ratings throughout the available range (-10 to 
+10), with a mean equal to zero. 

3. A distribution of scores significantly different from 
pure chance was a reliable indicator of pilot consensus. 

Tables 15-30 contain summaries of the responses to 
the pilot rating scale questions and the specific comment 
questions. The numbers above the rating scale are the 
individual subject pilot numbers who assigned that rating. 


Summary of Results 

Results show that there were few significant differences 
among the pilot ratings comparing the FD HUD with the 
panel instruments. The only exceptions are found for 
questions 2, 3, and 11, and in each of these cases there was 
a significant preference for HUD as compared with panel 
instruments. The areas of preference were: 

1. Lateral flightpath control (localizer) (question 2). 

2. Vertical flightpath control (ghde slope) (question 3). 

3. Personal preference, considering safety, economics, 
passenger comfort: an overall rating (question 1 1). 

For the FP HUD, subject pilots rated the display higher 
than the head-down panel on nine of the 11 scales. The 
two exceptions were: 

1. General situation awareness and aircraft position 
(question 4). 

2. Initiation of missed approach (question 9). 

In summary: 

1 . Although the FD HUD was generally not rated signif- 
icantly different from the head-down condition, it was 
rated as equal to or better than head down on all except 
two scales. 

2, For all cases the FP HUD was rated superior to the 
head-down instruments. In nine of 1 1 cases these prefer- 
ences were statistically significant. 


Pilot Responses to Yes/No Questions 

Questions 6, 9, and 10 of the HUD debriefing question- 
naire required a simple “yes” or “no” response. Sixty per- 
cent of the pilots indicated that they used the head-down 
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panel at least once for either primary reference or a cross- 
check on the HUD. Subject pilots 3, 4, and 11, all stated 
that they did not use the head-down panel displays with 
either HUD. Subject 8 used head-down information for the 
FD HUD approaches but not for the FP HUD. Use by sub- 
ject 10 was the opposite; he used panel instruments for 
FP HUD but not for FD HUD approaches. 

Although the size of user and nonuser groups did not 
depart significantly from “chance,” as measured by statis- 
tical techniques, it is clear that the majority of pilots felt 
the need to monitor the panel instruments at least 
on occasion. 

According to pilot comments, the panel instruments 
during FD HUD operations were monitored for go-around 
information, pitch attitude, general cross-checks, and DME. 
When using the FP HUD, pilots monitored their panel dis- 
plays for go-around information, pitch attitude, sink rate, 
heading, power settings, general cross-checks, and position 
information. One pilot commented that he checked the HSI 
because he “did not feel confident of this aircraft position” 
with the FP HUD. 

Pilot response to question 9 was unanimous; all pilots 
felt that both HUDs offered advantages over existing head- 
down displays. Those advantages mentioned most often in 
connection with the FP HUD were, “more precise” control 
of airspeed and altitude and the conformal cues of the 
synthetic runway. Several pilots referred to how “easy” it 
was to fly the FP HUD in varied environmental conditions. 
A major perceived advantage was being able to see the 
“world” at breakout, and this advantage was also the major 
one attributed to the FD HUD by the subject phots. In 
general, comments about the FP HUD were more explicit 
than those for the FD HUD. 

In response to question 10, pilots were again in nearly 
perfect agreement. Only one of the ten subject pilots felt 
that there were no disadvantages to either HUD. In general 
the disadvantages noted were common to both HUDs. 
Comments included “insufficient” pitch reference, situa- 
tion awareness, lack of IVSI, and a general reduction in 
forward visibility. Altitude hold was mentioned as a prob- 
lem area peculiar to the FD HUD. 


HUD Training Questionnaire 

Pilot reactions to the training program for Phase III were 
assessed by means of an eight part questionnaire in which 
the subjects were asked to rate the various phases of train- 
ing. Four of the eight questions dealt with such topics as 
the handout material, the classroom lectures, the video 
tapes employed, and the simulator training. The other two 


rating questions asked for an overall assessment and a prog- 
nosis for a revised and updated training program. Two 
questions were devoted to soliciting general comments from 
the subjects and desired changes, if any. 

Quantitative Results 

Tables 31 to 36 are summary plots of the training ques- 
tionnaire data. In all cases the distribution of pilot respon- 
ses was significantly different from chance. As a group, the 
phots felt that all phases of HUD training were highly 
effective. They also tended to give a high overall rating to 
the training program. 

When the subjects were asked if an upgraded training 
program might produce different results, the ratings, 
although still statistically significant, tended to show more 
scatter. This apparent uncertainty applied only to the FD 
HUD training. Ratings for the FP HUD were much more 
consistent, that is, they showed a smaller scatter. FP HUD 
ratings were also slightly higher, although the difference 
between the two HUDs was not statistically significant. 

Pilot Comments 

The pilots made relatively few comments in response to 
the training questionnaires. Most of the comments related 
to topics such as editing the handout materials and general 
structuring of the program. In general the pilots felt that 
the training program was quite good; they made no specific 
comments that reflected a general inadequacy in any given 
area of training. 

Comments relating to the FP HUD training were similar 
to these comments; they sometimes reflected technical 
problems encountered during the study rather than inade- 
quacies in the training program. Certain problems, such as 
simulator motion failures, equipment breakdowns, and 
software failures, were common to both types of HUD 
training and are, therefore, reflected in both questionnaires. 

Crew Procedures and Callouts 

Crew procedures used in the Phase III HUD study were 
evaluated by means of a seven part questionnaire. Pilots 
were unanimous in finding the copilot callouts useful 
during the study, and all pilots felt that, as the Captain, 
they would use a HUD during airline operations if it were 
available. Pilots also predicted that repeating the study 
using different procedures would produce little or no 
change. None of the pilots felt that there were too many 
callouts. 
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Pilots were also asked to provide specific recommenda- 
tions as to appropriate changes in crew procedures or call- 
outs. In response, six of the ten pilots indicated that the 
pilot not flying should make all or most of the callouts. 
Two of the subjects recommended specific changes in the 
callouts, but did not indicate which crewmember should 
make these calls. 


Simulation Debriefing 

One of the major concerns of any laboratory experiment 
concerns the element of realism. In any attempt to answer 
operational questions, it is imperative that the laboratory 
adequately “simulate” the “real world.” Although the 
theoretical arguments as to the required degree of simula- 
tion fidelity were avoided, the pilots were asked to evaluate 
simulator “realism” by rating various simulator characteris- 
tics. The results are summarized in the following paragraphs. 


Flying Characteristics 

When pilots were asked to rate simulator flying charac- 
teristics as “exactly like the B-727” (10) or “totally 
unlike the B-727” (0), their responses were widely scat- 
tered, ranging from a high of 9 to a low of 2. Pilot opinion 
was widely spread, and the distribution was not statisti- 
cally different from pure chance. It is interesting to note 
that those subjects who were most enthusiastic about the 
head-up display concept tended to rate the simulator flying 
characteristics higher than those subjects who either had 
some difficulty with the HUD concepts or experienced a 
long waiting period because of simulator problems. 

Pilots were asked to rate simulator visibility effects as 
“like the real world” (10) or “unlike the real world” (0). 
The mean rating was 7,6 on a 10-point scale vrith a low 
rating of 4 and a high rating of 9. In this case, group 
opinion was uniform and it differed statistically from 
pure chance. 


Wind and Turbulence 

Whereas the mean rating for wind and turbulence of 6.3 
did not depart significantly from chance, the general distri- 
bution of ratings was bimodal. The ratings of three subjects 
clustered at 4, and the rating of three subjects clustered at 
7. Ratings range from a low of 3 to a high of 10. Pilot 
opinion was clearly divided on wind and turbulence. Forty 
percent of the group felt that wind conditions were less 
than realistic while 60 percent of the group felt that they 
were quite realistic. 


Runway Obstructions 

Pilot reactions to the runway obstructions employed in 
the study were uniform and significant. The group mean 
rating of 8.9, with a standard deviation of 1.1, indicates 
that pilots felt that the runway obstruction was quite 
realistic. 

It should be noted that, although pilots had been 
instructed during training to watch out for unexpected con- 
ditions such as severe wind shear, reduced ceiling, runway 
obstructions, etc., they received no warning before being 
exposed to such conditions in the data-taking portions of 
the study. In all cases in which the runway obstruction was 
introduced, pilot response was dramatic. 


Repeat of Study 

Although the pilot ratings tended to be scattered from a 
low of 3 to a high of 10, the general rating indicated that 
most subjects felt that reproducing the study using an air- 
craft rather than a simulator would do little to change the 
results or conclusions. 


Distribution of Pilot Scores 

Examination of the distribution of pilot responses shows 
that some pilots tended to rate consistently on the low side 
of the distribution, while others consistently rated on the 
high side. For example, ratings of subject 6 were always 
below the mean, while ratings of subjects 4 and 10 were 
above the mean 100 percent of the time. Further inspec- 
tion reveals that subjects 3 and 5 rated below the mean 80 
percent of the time, while subjects 2, 8, and 1 1 rated above 
the mean 80 percent of the time. While such a conservative/ 
liberal bias was not totally unexpected, it does raise 
some questions. 

When the test-subjects data runs were reviewed for pos- 
sible answers, it was noticed that those subjects who were 
“low” raters had experienced severe or repeated technical 
problems during the course of their simulator runs. These 
problems resulted either in delays, which resulted in inter- 
ruptions and unscheduled waiting periods during the data 
runs, or in simulator failures, which produced unexpected 
control responses in the simulator handling or motion 
characteristics. “High” raters, on the other hand, exper- 
ienced none or fewer simulator breakdowns, and, in gen- 
eral, experienced fewer frustrating delays. It does appear, 
therefore, that personal evaluations of simulator effective- 
ness were at least partially affected by the subjects’ per- 
sonal experiences during the course of the study. 
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Supplemental Questionnaire 


DISCUSSION AND CONCLUSIONS 


After the study was completed, a supplemental question- 
naire was sent to the pilots to get additional information on 
several issues. The pilots were asked if they had previous 
experience with a cross-pointer flight director display. All 
pilots in the study currently fly aircraft equipped v^dth the 
single-cue flight-director display. Answers revealed that all 
except one of the subject pilots had extensive line exper- 
ience with a cross-pointer flight director. 


Pilot Response Summary 

The following paragraphs summarize the pilot responses 
to the supplemental questionnaire: 

1. Nine of the ten pilots felt that they had sufficient 
practice with the flight simulator prior to testing. One sub- 
ject said that 1 to 2 hr “might” help, and one subject sug- 
gested adding 4 to 20 practice hr. This subject felt at 20 hr 
of training on the HUD would give a better basis for com- 
parison because this is “normally the amount of time in the 
simulator given to head-down instruments by the airlines.” 

2. Only one of the subjects had no previous hne exper- 
ience with a cross-pointer flight director. He did not, how- 
ever, feel that additional time was needed for further 
training on the use of this display. 

3. Six of the ten subjects indicated that, during line 
operation, they typically used the flight director for “tight” 
tracking and monitored the raw data, whereas three of the 
subjects said that they tracked the flight-director command 
signal “loosely.” 

4. When asked about airline policy and flight director 
usage during nonprecision approaches, four subjects said 
that the flight director was not used during nonprecision 
approaches; one said that it was used; two said that use was 
optional; and two subjects said that they used raw data. 

5. Forty percent of the subjects said that further prac- 
tice would have improved their FD HUD performance, 
whereas 60 percent of the subjects said that further practice 
would not have helped. Those who felt that additional time 
would be useful estimated the amount of additional simu- 
lator practice time to be 10 to 20 hr. 

6. In the case of the FP HUD, 70 percent of the subjects 
felt that additional simulator practice time (estimates 
ranged from 1 to 15 hr) would have improved 
their performance. 


This discussion is based primarily upon the formal 
results of the Phase III experiment as reported in the pre- 
vious paragraphs. However, wherever possible, other sources 
of information are considered as weU, including the intan- 
gible but valuable experience with head-up displays that 
has accumulated during the course of the program. 

Because the primary objective of the study was to deter- 
mine the potential advantages and disadvantages of the 
head-up display concept for line operations, much of the 
discussion is directed toward generic issues; that is, this 
study was not intended to be a product evaluation, but 
rather a concept evaluation. Obviously, it was necessary to 
use a specific implementation of the HUD concept, and the 
results herein are given for two HUD concepts. In this sec- 
tion, those device-specific results are interpreted in terms 
of their implications for the broader, more generic issues. 

In this discussion, two major questions are addressed: 
(1) Are there advantages and benefits to be gained by using 
head-up displays in civil-transport operations? (2) Are 
there problems associated with their use? 


Advantages and Operational Benefits of HUDs 

The most general statement that can be made regarding 
the results of the objective performance maneuvers used in 
this experiment is that, when compared with the conven- 
tional instrument panel, both the FD HUD and FP HUD 
improved the accuracy (i.e., smaller errors) and precision 
(i.e., smaller dispersions) of pilot control of numerous 
flight parameters during approaches in a variety of environ- 
mental and operational conditions. 

During ILS approaches, both the localizer and glide 
slope tracking performance was better for both HUDs than 
the NO HUD case, with the FP HUD showing the best per- 
formance. The magnitude of the performance differences 
is of great interest. For example, localizer error was reduced 
by better than a factor of 2 when using the FP HUD. 
Similar changes are seen for glide slope error. These two 
parameters were determined to be statistically significant. 
However, it is important to distinguish between statistical 
significance and operational significance. Statistical 
significance is simply a measure of the probability that 
an observed difference is caused by experimental treatment 
and not by chance fluctuations in the measured variables 
that is, a type of unwanted “noise.” Statistical significance 
impUes little, if anything about operational significance. In 
this light, it is interesting to look closely at these data. For 
example, for the NO HUD case in the approach segpaent 
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where stabilized localizer tracking is expected (and opera- 
tionally important), the rms localizer error averages 0.13^. 
Performance with the FP HUD averages 0.06°, a ratio of 
2.2:1. Translated into “dots” deflection on the raw data 
localizer, however, these differences appear to be much 
smaller; 0.13° corresponds to approximately 0.1 
dot deflection. 

In order not to lose or obscure some important individ- 
ual performance characteristics by only using summary 
statistical data, considerable effort was spent examining the 
outher data points represented by the maximum and 
minimum values for the various parameters. For example, 
in the glide slope and localizer tracking data, the larger 
values almost always occurred on runs that started at the 
4000 ft starting altitude. On these runs, the pilots overshot 
glide slope and localizer during the intercept maneuver and 
by the time they had begun the recapture maneuver, they 
were into the approach segment. The reasons for overshoot- 
ing during the intercept are discussed in the Results section 
and will be addressed in the Potential Problems section that 
follows. However, it is important to recognize that during 
these runs, once the pilot recognized the overshoot and 
started to recapture, the task was easily accomplished using 
either of the HUDs. This has some practical significance 
since in line operations, deviations from otherwise normal 
approaches can be expected occasionally and new displays 
must provide the pilot with the capability to handle them. 

The airspeed performance measures for aU displays 
across all conditions showed that remarkably consistent 
performance was obtained. Since the digital readout of air- 
speed and the airspeed error worm available in both HUDs 
and the potential flightpath symbol found in the FP HUD 
only were new presentations, the pilots’ acceptable level of 
performance with them is significant. In response to the 
question about speed control and thrust management, the 
pilots preferred both HUDs over the instrument panel but 
only the FP HUD results were statistically significant. It 
would appear that the greater acceptance of the FP HUD in 
this area is to a large degree due to the addition of potential 
flightpath information. 

One area in which the FP HUD was apparently beneficial 
was in the nonprecision approach. Because of the unique 
potential afforded by use of a conformal flightpath ele- 
ment, which the pilot can “fly to” a desired touchdown 
point on the runway, the final approach vertical profile is 
much closer to the ideal 3° glide slope. When using the FD 
HUD and NO HUD, the pilots showed a marked tendency 
to wait too long to begin the final descent to the runway 
from the MDA, However, with the FP HUD, crossing alti- 
tudes (and associated deviations) at the middle marker and 
the threshold correspond very closely with those obtained 
on the full ILS approaches. Subject pilot comments and 


observer data strongly corroborate these findings. This 
observation may be one of the more significant ones with 
regard to a FP HUD. There are other ways to improve pre- 
cision or reduce dispersion during approach and landing 
operations, a properly designed autoland system being one 
good example. However, autoland requires appropriate 
ground facilities. A FP HUD is self-contained and can be 
used for any kind of approach to any runway. Because of 
economic and operational realities, it is reasonable to 
assume that a significant proportion of jet-transport 
approaches will continue to be flown manually and without 
electronic -glide slope information. The results of this study 
demonstrate that a properly designed FP HUD may contri- 
bute to improved precision in these kinds of operations, but 
it is also necessary to point out that this simulation did not 
include a visual-approach-slope-indicator (VASI). The 
benefits of this device are widely recognized but it does 
have limitations, one being that it cannot be used below 
approximately 200 ft. It is beyond the scope of this study 
to determine which of the two techniques offers the best 
solution to the visual approach problems, but it seems 
likely that they may offer complementary benefits. 

In the flare and landing segment, pilots performed best 
with the FP HUD. The scatter of data at the runway thres- 
hold window was minimum and the landing footprint 
showed the least scatter. Sink rate at touchdown was small- 
est for the FP HUD but the mean distance down the run- 
way was slightly longer than for the NO HUD runs. This is 
most likely due to the flare guidance information provided 
in the FP HUD. Past experience demonstrated that follow- 
ing the flare Une closely often resulted in reduced sink rates 
at touchdown but at some greater distance down the run- 
way. However, this seemed to be counterbalanced by the 
reduced dispersion in landing distance across aU runs. 

On the other hand, the FD HUD data did not follow the 
same pattern seen in the previous segments. Performance 
was the same or worse than for the NO HUD approaches. 
Some reasons for this are discussed in the next section. 
However, pilot comments indicated there was still a pref- 
erence for the FD HUD over the NO HUD condition. 


Potential Problems with HUD 

One area of potential concern with regard to HUD 
design relates to the integration of horizontal and vertical 
situation information. Although the FP HUD contained 
enough information to support the localizer intercept man- 
euver, some of tlie subject pilots had difficulty determin- 
ing their horizontal situation from this HUD during that 
phase of operation. The exact cause of this difficulty was 
not determined. It may have been due to insufficient train- 
ing in the use of the symbology in that particular segment 
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of flight. In response to one of the questionnaire items, 
many pilots indicated that they used the HSI to cross- 
check or verify their position during the radar vectoring 
part of the data scenarios. This problem was noted fre- 
quently during subject pilot training. 

Another possible cause might be the design of the sym- 
bology itself for that maneuver. These subjects had all 
accumulated vast experience with panel displays that use 
separate instruments for horizontal situation information 
(HSI) and vertical situation information (ADI). Position 
and orientation with respect to ground facilities is rela- 
tively easy with a conventional HSI and/or radio magnetic 
indicator (RMI); both have arrows or flags, which “point 
to” the facility, and information which pictorially displays 
the relative positions of aircraft, and facilities. With the 
advent of electronic displays, including HUD, it is pos- 
sible to integrate horizon tal-and vertical-situation informa- 
tion into one common display format. The effective design 
of such displays is not an easy task, however, and subject 
pilots offered many comments about this problem. The 
major factor accounting for the most adverse pilot com- 
ments seemed to be the fact that the perceptual frame of 
reference for the HUD is oriented vertically compared to 
the horizontal frame of reference for the HSI, AU of these 
observations may have implications for HUD operating 
procedures. Given the difficulties observed with both HUD 
formats used in this study, especially' during the approaches 
from 4000 ft altitude with the crosswind and tailwind 
cases, it is fair to say that HUD design and/or training 
procedures might be improved. It is also possible that full 
time use of a HUD during terminal area maneuvering 
might not be a desirable operational objective. Design 
efforts might focus instead upon the straight-in approach 
and landing operations; terminal-area maneuvering and 
intercept operations mi^t continue to be best accom- 
plished by using conventional panel instruments. 

One of the major issues often raised with regard to head- 
up displays is that of attentional or perceptual switching. 
Past experience with the HUD concept indicates that there 
is a definite attentional “cost” associated with using a HUD. 
While it is true that the physical movement of the head and 
eyes required to scan the instrument panel and the outside 
world is drastically reduced by using a HUD, it is still 
necessary for the pilot to mentally scan, that is, to alternate 
his attention between the HUD symbology and the outside 
visual cues. This scanning appears to require deliberate 
action on the part of the pilot; the mere presence of a stim- 
ulus in the visual field does not guarantee that it will 
be perceived. 

Several examples of this were noticed during the Phase 
III experiment. One case involved the use of the FD 
HUD. Pilots commented that in following the command 


dot closely, they were unable to attend to the outside 
scene. Similarly, in the flare segment where the fli^t 
director information was not valid, it became difficult to 
ignore it and use the outside scene alone. Another example 
involved the use of the flare guidance in the FP HUD. If the 
pilot followed the flare line very closely but to the exclu- 
sion of the outside scene, he would get a low sink rate at 
touchdown but possibly at considerable distance down 
the runway. 

Another example was the runway obstruction anomaly. 
In the 13 runs where this anomaly was introduced into the 
simulated external visual scene, the pilots recognized the 
obstruction and executed a missed approach in all cases. 
However, in each case there was a delay in the pilot recogni- 
tion of the presence of the anomaly. It was not possible 
within the experimental design to determine the exact 
source or the operational significance of the delays. It is 
possible that the simulation itself might have contributed to 
the generation of the observed phenomena either through 
the physical and visual qualities of the simulator or through 
the psychological effect of the research environment. 

Two important consequences follow from these observa- 
tions. First, the design of the HUD may radically alter this 
“attentional switching,” and it may be possible to design a 
HUD in such a way that scanning behavior is considerably 
enhanced. A specific example is found in the FP HUD used 
in this study. For the precision approach case, this HUD is 
“self-contained,” that is, the display contains sufficient 
information to fly the entire approach, flare, and landing 
maneuver without references to outside visual cues. The dis- 
play does not inherently require “attentional scanning” of 
the external scene. A simple change to the display, namely, 
the elimination of the flare guidance symbol, would change 
this situation. At some point prior to and during the flare, 
the pilot would be forced to attend to the visual environ- 
ment. It seems probable that this necessity would affect 
other related tasks, including the detection of obstacles on 
the runway. 

The second area of consideration regards the importance 
of training and experience and the influence of these 
factors upon the “attentional scanning” task. Several 
project personnel noted that the task of scanning the 
HUD, including directing attention to the runway environ- 
ment, appeared to become easier as proficiency and 
experience with either of the HUDs increased. It is reason- 
able to believe that “attentional scanning” is a skilled 
behaviour that can be acquired through appropriate training 
and experience; a pilot’s development of conventional 
instrument flight skills is an obvious example. A unique 
training requirement may exist in the case of HUD. It is 
therefore recommended that programs for training line 
pilots in the operation and use of a HUD include 
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elements specifically directed toward this “attentional 
scanning.” 

As with any new technology, it is never possible to anti- 
cipate all potential problems. Thus, a cautious, conservative 
approach should be taken during the early stages of line 
operations using these devices. As experience is gained with 
the displays, training programs, and operating procedures, 
problems can be identified and solved in an orderly and 
safe manner. 

Observations and Conclusions on Secondary Issues 

In addition to evaluating the impact of HUD upon sys- 
tem performance during approach and landing operations. 
Phase III was designed to make a preliminary assessment of 
other issues not directly related to HUD design. The two 
most important are crew training requirements and flight- 
crew operating procedures associated with HUDs. Although 
it is beyond the scope of this study to conduct a thorou^, 
systematic evaluation of the various approaches that might 
be taken to resolve these issues, it is possible to com- 
ment upon both on the basis of experience gained during 
the present program. 

As indicated earlier, the subject-pilot training program 
was based upon current approaches to flight-crew training- 
program development. The decision to utilize a combina- 
tion of handbook materials, classroom exercises, video 
tapes, slide materials, and simulation training was based on 
this consideration. The result was a training program that 
largely achieved its objective and had a generally high 
degree of acceptance by the pilots who participated in this 
experiment. On the basis of pOot performance at the end of 
the training program, it appeared that subject pilots gen- 
erally understood the operational procedures and concepts 
involved in using each of the HUDs and that they were 
reasonably proficient in applying that knowledge. Some 
caution is necessary, however, since training requirements 
for the two HUDs were appreciably different. The FDHUD, 
excluding for the moment its nonprecision visual approach 
monitor (VAM) modes, was an easy concept for the pilots 
to grasp; essentially, it is a head -up equivalent of what they 
have flown for years. The flightpath displays, including the 
VAM modes on the FD HUD, were somewhat more diffi- 
cult to learn. For most line pilots, the concept of a flight- 
path or velocity vector symbol is a new one. Furthermore, 
an understanding of the relationship between the flightpath 
symbol and other display elements may require special 
training, particularly if the display is designed in such a way 
that some pilot discretion is allowed. For example, typi- 
cally an aircraft is flown in level flight at the initial 
approach altitude until glide-slope capture occurs. With a 
FP HUD as implemented for this study, it is possible to 
conduct a smooth, gentle convergence maneuver by initiat- 
sequence and length of elements of the training program are 
“in the ballpark.” It should be noted however, that learning 


ing a shallow descent when the glide-slope signal intercepts 
the flightpath symbol. Alternatively, the pilot can fly the 
glide-slope intercept in a conventional fashion. This added 
flexibility requires some additional training and/or experi- 
ence before flight crews become fully proficient with the 
display. Similar comments apply to other features of the 
display, including flare guidance, MDA capture, and the use 
of the potential flightpath symbol for thrust management. 

It is believed that the training program developed for 
this project represents a good starting place for an opera- 
tional training program. The general approach and the 
is not complete after a training program as short as the one 
used for this study. As the pilot gains more experience with 
the concept under a wider variety of conditions, he wiU 
become more proficient in its use. Thus, an operationally 
acceptable training program should include a period of line 
experience, perhaps with higher than normal minima. Dur- 
ing this time the line pilot could consolidate his knowledge 
and skills. The specific details of this program would 
depend upon the display, the air carrier, and its operating 
procedures; they would have to be determined on a case-by- 
case basis. 

The question of operating procedures suitable for use 
with a HUD is in many ways more complex than the train- 
ing question. The procedures used in this study worked 
well and were acceptable to the subject pilots. However, it 
is believed that many other possible procedures would work 
equally effectively. Generally, the development of suitable 
operation procedures is a matter of airline and regulatory 
philosophy, it is not generally an empirical issue. The 
philosophy adopted herein was straightforward: an attempt 
was made to maximize crew coordination and communica- 
tion by distributing callouts and acknowledgments in such a 
way that both pilots were “in the loop” and both could 
cross-check and monitor each other through the use of 
independent, redundant displays. The fact that the copilot 
monitored the approach by using the instrument panel was, 
in part, because good HUD information was present only 
on the left side in the simulator. However, it also appears 
that this approach maximizes the redundancy of informa- 
tion, even in aircraft equipped with a dual HUD installa- 
tion. Thus, if there are problems with attention switching, 
flash blindness, or other factors uniquely associated with 
HUDs, the conservative approach to the development of 
flight-crew operating procedures would be to have the pilot 
not flying monitor the approach by using conventional 
instrument information. Obviously, this is partly a system- 
design question. A detailed examination of these issues is 
beyond the scope of this study. 

Ames Research Center 

National Aeronautics and Space Administration 
Moffett Field, CA 94035, February 8, 1982 


22 



APPENDIX A 


PHASE II REPORTS 


1. Bray, R. S.: A Head-Up Display Format for Applica- 
tion to Transport Aircraft Approach and Landing. 
NASA TM-81 199, 1980. 

2. Fischer, E.: The Role of Cognitive Switching in 
Head-Up Displays. NASA CR-3137, 1979. 

3. Fischer, E.; and Haines, R. F.: Selected Cognitive 
Issues with Head-Up Displays. NASA TP-1711, 1980. 

4. Guercio, J. G.; and Haines, R. F.: A Preliminary 
Study of Head-Up Display Assessment Techniques. 
II. HUD Symbology and Panel Information Search 
Time. NASA TM-78536, 1978. 

5. Haines, R. F.: Head-Up Transition Behavior of Pilots 
During Simulated Low Visibility Approaches. NASA 
TP-1618, 1980. 

6. Haines, R. F.: Preliminary Study of Head-Up Display 
Assessment Techniques. I. Viewing Duration of Instru- 


ment Panel and HUD Symbology Using a Recall 
Methodology. NASA TM-78517, 1978. 

7. Haines, R. F.: Project Plan for Joint FAA/NASA 
Head-Up Display Concept Evaluation. NASA 
TM-78512, 1978. 

8. Haines, R. F.; Fischer, E.; and Price, T. A.: Head-Up 
Transition Behavior of Pilots With and Without a 
Head-Up Display in Simulated Low Visibility 
Approaches. NASA TP-1720, 1980. 

9. Leitner, E. F.; and Haines. R. F.: Magnitude of Visual 
Accommodation Using a Head-Up Display. NASA 
TP-1796, 1981. 

10. Naish, J. M.: A Review of Some Head-Up Display 
Formats. NASA TP-1499, 1979. 

11. Naish, J. M.: Head-Up Display in the Non-Precision 
Approach. NASA TM-81 167, 1980. 


23 



APPENDIX B 


FLIGHT DIRECTOR HEAD-UP DISPLAY 
Phase III Training Handbook 


INTRODUCTION TO HEAD-UP DISPLAYS 


Head-up displays have been in use for several years. 
Probably the most familiar form of head-up display is as 
the “sight” portion of a weapons delivery system on mili- 
tary aircraft. On these displays, commands and information 
are displayed directly in the field of view of the pilot/ 
gunner. With advances in head-up technology, displays are 
being proposed that would incorporate aircraft operative 
modes other than for weapons delivery. 

Head-up displays may be advantageous to the pilot. If 
primary aircraft-operating information is presented directly 
within the pilot’s field of view, he has less need to scan the 
instrument panel and divide his time between the inside 
(cockpit) and outside worlds. 

As the need to “come inside” for information is 
reduced, there may be a greater proportion of time avail- 
able to scan outside, and, therefore, the adaptation of head- 
up displays should lead to greater aircraft safety 
during operation. 

The head-up display may, however, present some disad- 
vantages. Superimposed images may be distracting and may 
clutter the external visual scene, “masking” objects of vital 
interest to the pilot. The probability of errors may increase, 
with a reduction in safety rather than an increase. This 
study is designed to provide insight into some of these 
issues and questions. 

Head-up displays (or HUDs) are of many forms, ranging 
from simple glass plates to acrylic blocks. Display informa- 
tion ranges from simple steering commands to complex 
“conformal” displays in which selected dynamic display 
elements bear a one-to-one relationship to the “real” or 
outside world. 


Phase III — Scope 

Within the Phase III HUD study, the area of HUD apph- 
cation is limited to final approach, landing, and go-around 
piloting operations. Two types of HUDs will be examined, 


an unreferenced flight director and a conformal flightpath 
display. The flight director essentially duplicates the infor- 
mation presently displayed on the instrument-panel flight 
director and presents this information along with airspeed, 
altitude, and attitude within the visual field of view. The 
conformal display presents information some of which is 
not presently available on standard aircraft instruments. 

The pilot’s primary task in any case is the same: He flies 
selected instrument approaches and landings under various 
environmental conditions. These approaches, conditions, 
and pilot procedures provide a reasonable simulation of air- 
line operations for experimental purposes. 

All pilots in this study will fly experimental runs using 
three display types: (1) the standard instrument panel; 
(2) an unreferenced flight-director HUD; and (3) a con- 
formal flightpath HUD. 


Phase III — Pilot Training 

During training for Phase III, each pilot will receive both 
classroom and simulator training in the use of the head- 
up displays. 

Classroom training- During classroom training, the pilot 
will become familiar with HUD symbology and operation 
by means of a training pamphlet and visual aids such as 
slides and video tape. In all cases pilots will be trained in 
both ILS and nonprecision modes of operation. POots will 
be asked to fill out worksheets and questionnaires to deter- 
mine their understanding of the display symbology. After 
the classroom training, pilots will fly specific training runs 
in the simulator. 

Simulator training- In the simulator, pilots will fly 1 1 
different training runs, consisting of varying conditions of 
visibility and winds as well as course offsets. Each pilot will 
receive 2 hr of training in the classroom and 2 hr in the 
simulator for each HUD display, plus 1 hr of simulator 
orientation. Thus each pilot will receive 4 hr of training (in 
the classroom) and 5 hr in the simulator, and an additional 
1-2 hr wiU be spent for debriefings and filling out 
questionnaires. 
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HUD TYPE I FLIGHT-DISPLAY 


HUD Type I is an unreferenced flight-director display. 
In concept, the display provides guidance without specific 
reference to any ground object. Using processed informa- 
tion, the display provides a fly-to command in 
geographical coordinates. 

General Description 

Command guidance is provided on the display by a mov- 
able dot symbol located at the apex of a stack of three 
crossbars. The pilot’s task is to fly a “fixed” circle onto the 
dot. This fixed circle represents the aircraft, and the wings 
of the circle are parallel with the lateral axis of the aircraft. 
While the aircraft circle remains in the center of the display, 
the command dot moves parallel to the horizon for heading 
(azimuth) commands and perpendicular to the horizon for 
height (elevation) commands (see fig. 23). 

The aircraft circle is also equipped with a variable -length 
vertical fin that bisects the circle. As the velocity of the air- 
craft deviates from a given reference speed, the vertical fin 
will project above the circle to show positive error (fast) 
and below the circle to show negative error (slow). Speed- 
error is equal to a one-dot deviation for every 10 knots of 
airspeed. When the artificial horizon is not visible, such as 
at extreme pitch angles, the crossbar stack provides the 
pilot with a roU reference as it rotates about the command 
dot. It also serves to assist the pilot in locating the 
command dot. 

Supporting Elements 

An artificial horizon is provided in the form of a bar 
with a gap spanning the aircraft circle. It shows bank angles 
by rotating with the earth’s horizon and shows elevation 
(“pitch attitude”) at a reduced scale. Other supporting ele- 
ments are digital readouts of altitude (upper right), airspeed 
(upper left), and engine pressure ratio (lower left). Addi- 
tional information includes a heading scale at the top of the 
display, raw glide slope (on the right), raw localizer (on the 
bottom), and instantaneous vertical speed (on the left). The 
last information provided is an annunciator in the lower 
right-hand comer of the display, which annunciates the 
various flight-director modes. Directly above this indicator, 
a flashing designator appears momentarily to announce 
outer-, middle-, and inner-marker crossing points. 

Annunciator Legends 

The five basic modes of interest within the present scope 
of study are aimunciated in the lower right-hand comer of 
the display as; 


1 . GS CAP (glide-slope capture) 

2. GS APR (glide-slope approach) 

3. ALT HLD (altitude hold) 

4. HT RTE (height rate) 

5. GO ARD (go-around) 

In typical flight-director usage, the annunciator will read 
GS CAP during the level segment of a beam intercept in a 
precision approach and GS APR during the ensuing descent. 
In a nonprecision approach, the legend reads ALT HLD 
when altitude hold is selected, which is usually set before 
final-approach fix and at MDA. When the nonprecision 
mode is being used and altitude hold is not selected, the 
annunciator will normally read HT RTE. In the HT RTE 
mode, the flight-director command dot is preprogrammed 
for a 1000 ft/min rate of descent. When the go-around 
mode is selected, a predetermined pitch attitude is com- 
manded and GO ARD is annunciated in the “window.” 

Driving Signals 

During precision approach the flight-director command 
dot is driven by signals derived from the ILS deviations in 
azimuth and elevation (localizer and glide slope). For the 
nonprecision approach, the glide-slope deviation is unavail- 
able and an alternative driving signal is required. This signal 
is generated by comparing the actual rate of descent of the 
aircraft with a desired rate of descent. In actual practice 
this desired rate of descent would be selected by the pilot 
after a consideration of airpeed, altitude, and desired glide- 
path. During this study, it is set at 1000 ft/min for descent 
to MDA. When altitude hold is engaged, level flight is com- 
manded. When the winged circle is alined vertically with the 
dot, the pilot will achieve his desired rate of descent or 
“height rate.” In the nonprecision approach, the raw glide 
slope is blanked to reduce clutter. 


MAJOR DISPLAY ELEMENTS 


The major display elements consist of (1) peripheral 
elements whose positions and orientations are fixed relative 
to the aircraft; and (2) central elements whose positions 
and orientations generally move as functions of changes in 
aircraft control inputs and aircraft orientation. One excep- 
tion in the central elements is the aircraft symbol, which is 
fixed in the center of the display. 

Peripheral Elements 

Peripheral elements of this display include the following; 

1. Heading scale located at the top of the display and 
numbers at the 10° marks with intermediate marks at the 
5° intervals. 
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2. Airspeed and altitude digital readouts on the upper 
left and upper right of the display. 

3. Engine-pressure-ratio digital readout at the lower left 
of the display, 

4. Annunciator callouts at the lower right of the display. 

5. Instantaneous-vertical-speed-indicator scale along 
the left side of the display; at the bottom is the localizer 
scale and on the right is the glide-slope scale. 


Central Elements 

Central elements, with the exception of the aircraft 
symbol, have a general geographical relationship to the out- 
side world as follows: 

1 . The speed-error tape attached to the aircraft symbol 
maintains a constant relationship to the aircraft ref- 
erence and is always perpendicular to the wings of the 
aircraft symbol. 

2. The artificial horizon spanning the aircraft symbol 
provides pitch and roll information. 

3. The command dot represents the crossing points of 
the lateral and pitch steering commands. 

4. Three bars of graduated length are grouped below the 
command dot and provide roll information at extreme 
pitch angles where the horizon is not in view; they also 
guide the pilot’s eyes to the command dot. 


As the phot, you are instructed by ATC to maintain a 
1400-ft altitude and 135 knots to the outer marker. You 
have reached the outer marker and are cleared for land- 
ing. Refer to figure 24 and circle the correct answer in 
the following: 


1. Airspeed: 

Fast 

Slow 

On 

Unknown 

2. Altitude: 

High 

Low 

On 

Unknown 

3. Localizer: 

Right 

Left 

On 

Unknown 

4. Glide slope: 

High 

Low 

On 

Unknown 

5. Flightpath: 

Climbing 

Descending 

Level 

Unknown 


From your analysis of the display, what corrective action, if 
any, would you take and why?* Do you have sufficient 
information for analysis? If not, what additional informa- 
tion do you require? 


Situation B 


The initial conditions are the same as in Situation A. 
Refer to figure 25 and circle the correct answer in 
the following: 


1. Airspeed: Fast 

2. Pitch angle: High 

3. Heading: Right 

4. Flightpath: Climbing 

5. Sink rate: High 


Slow 

Low 

Left 

Descending 

Low 


On Unknown 
On Unknown 
On Unknown 
Level Unknown 
Normal Unknown 


After you consider figure 25, what corrective action, if any, 
would you take and why? Do you have sufficient informa- 
tion for analysis. If not, what additional information do 
you require? 


SAMPLE PROBLEMS 

Sample situations as depicted on the head-up display 
•(HUD) are presented in this section. For each situation, a 
set of initial conditions or constraints is given, and the pilot 
is asked to analyze the display and recommend corrective 
action, if necessary. 

Situation A 

Initial conditions are: 

1. Reference airspeed: 135 knots 

2. Altitude: 1400 ft 

3. ILS approach 

4. Runway heading: 090® 

5. Visibility: 5 miles 

6. Ceiling: 1000 ft 


Situation C 

You are making a nonprecision approach to a runway 
heading of 90®, with an MDA of 450 ft, airport visibility of 
5 miles, and a ceiling of 600 ft. Your reference airspeed is 
135 knots and this is a localizer-only approach. The flight 
director is in the nonprecision mode (HT RTE) and is com- 
manding a 1000-ft/min sink rate. Refer to figure 26 and 
circle the correct answer in the following: 


1. Airspeed: 

Fast 

Slow 

On 

Unknown 

2. Altitude: 

High 

Low 

On 

Unknown 

3. Heading: 

Right 

Left 

On 

Unknown 

4. Flightpath: 

Climbing 

Descending Level 

Unknown 


5. Acceleration: Increasing Decreasing Steady Unknown 

From you analysis of figure 26, what corrective action, if 
any, would you take and why? Do you have sufficient 
information for analysis? If not, what additional informa- 
tion do you require? 


26 



CREW PROCEDURES 


Crew procedures practiced by major airlines for similar 
aircraft are modified and generalized for this study. The air- 
craft being simulated is the Boeing 727. However, the flight 
engineer’s position is not simulated. The crew for this study 
is a captain, a copilot, and an observer. The observer will 
not function as part of the flying crew. 

Pilot Duties 

In all experimental cases, the left-hand seat will be 
occupied by the captain, the flying pilot for all experi- 
mental runs. The general duties of the captain require that, 
once the simulator is placed in “operate,” he will fly the 
prescribed profile as given by the simulated air-traffic con- 
troller and terminate his flight with either a landing or a 
go-around, whichever is appropriate. The captain will ask 
the copilot to go through the final-descent checklist and 
handle landing gear and flaps. The captain will be assisted 
by the copilot only “as requested.” 

Copilot Duties 

The copilot for all experimental runs will be an Ames 
employee. As copilot he will make flap and landing-gear- 
handle settings at the pilot’s request. He will monitor air- 
speed, altitude, and aircraft attitude during final approach 
and make callouts as prescribed in the summary that fol- 
lows. At the captain’s request he will initiate and complete 
the final-descent checklist. He will respond to ATC com- 
munications and will initiate ATC communication at the 
captain’s request. 


SUMMARY OF FLIGHT-CREW PROCEDURES FOR 
HUD PHASE III 


Captain (Pilot Flying) 

The captain will determine the approach target speed by 
using VjQf (124 knots at 140,000 lb) plus one half the 
headwind component plus the gust factor. Total add-on 
should not exceed 20 knots. 


The captain should call for landing gear and flaps as 
required. The captain should also request the copilot to 
select desired flight-director modes. 

Standard callouts for the captain are: 

Outer-marker crossing altitude, target speed, minimums 
and time to missed approach point (MAP) (nonpreci- 
sion only) 

1000 ft AGL 

100 ft above minimums 

Minimums 

In addition to the standard callouts, the captain should 
verbally announce ground contact, approach lights, or run- 
way threshold as appropriate (HUD approaches only). 

Copilot (Pilot Not Flying) 

The copilot will handle all ATC communications and 
operate the landing gear, flaps, and flight-director-mode 
control panel as requested by the captain. 

The copliot should acknowledge all standard callouts by 
the captain. 

The copilot will monitor the approach and will callout 
the following deviations: 

Airspeed deviations in excess of +10 or -5 knots. 

Localizer and glide -slope deviations in excess of 1 dot. 

Below 1000 ft above field level (AFL), sink rates in 
excess of 1000 ft/min. 


The copilot wiU monitor time on nonprecision approaches 
and will call out “Missed Approach Point.” 

For head-down approaches, the copilot wiU announce 
“ground contact, approach lights, runway threshold” 
as appropriate. 
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APPENDIX C 


FLIGHTPATH HEAD-UP DISPLAY 


Phase III Training Handbook 


INTRODUCTION TO HEAD-UP DISPLAYS 


Head-up displays have been in use for several years. 
Probably the most familiar form of head-up display is as 
the “sight” portion of a weapons delivery system on mili- 
tary aircraft. On these displays, commands and information 
are displayed directly in the field of view of the pilot/ 
gunner. With advances in head-up technology, displays are 
being proposed that would incorporate aircraft operative 
modes other than for weapons delivery. 

Head-up displays may be advantageous to the pilot. If 
primary aircraft-operating information is presented directly 
within the pilot’s field of view, he has less need to scan the 
instrument panel and divide his time between the inside 
(cockpit) and outside worlds. 

As the need to “come inside” for information is 
reduced, there may be a greater proportion of time avail- 
able to scan outside, and therefore, the adaptation of head- 
up displays should lead to greater aircraft safety 
during operation. 

The head-up display may, however, present some disad- 
vantages. Super-imposed images may be distracting and 
may clutter the external visual scene, “masking” objects 
of vital interest to the pilot. The probability of errors may 
increase with a reduction in safety rather than an increase. 
This study is designed to provide insight into some of these 
issues and questions. 

Head-up displays (or HUDs) are of many forms, ranging 
from simple glass plates to acrylic blocks. Display informa- 
tion ranges from simple steering commands to complex 
“conformal” displays in which selected dynamic display 
elements bear a one-to-one relationship to the “real” or 
outside world. 


Phase III — Scope 

Within the Phase III HUD study, the area of HUD appli- 
cation is limited to final approach, landing, andgo-around 
piloting operations. Two types of HUDs will be examined. 


an unreferenced flight director and a conformal flightpath 
display. The flight director essentially duplicates the infor- 
mation presently displayed on the instrument-panel flight 
director and presents this information along with airspeed, 
altitude, and attitude within the visual field of view. The 
conformal display presents information some of which is 
not presently available on standard aircraft instruments. 

The pilot’s primary task in any case is the same: He flies 
selected instrument approaches and landings under various 
environmental conditions. These approaches, conditions, 
and pilot procedures provide a reasonable simulation of air- 
line operations for experimental purposes. 

All pilots in this study will fly experimental runs using 
three display types: (1) the standard instrument panel, 
(2) an unreferenced flight-director HUD, and (3) a con- 
formal flightpath HUD. 


Phase III — Pilot Training 

During training for Phase III, each pilot will receive both 
classroom and simulator training in the use of the head- 
up displays. 

Gassroom training— During classroom training, the pilot 
win become familiar with HUD symbology and operation 
by means of a training pamphlet and visual aids such as 
slides and video tape. In all cases pilots will be trained in 
both ILS and nonprecision modes of operation. Pilots 
will be asked to fill out worksheets and questionnaires to 
determine their understanding of the display symbology. 
After the classroom training, pilots will fly specific training 
runs in the simulator. 

Simulator training- In the simulator, pilots will fly 1 1 
different training runs, consisting of varying conditions of 
visibility and winds as well as course offsets. Each pilot will 
receive 2 hr of training in the classroom and 2 hr in the 
simulator for each HUD display, plus 1 hr of simulator 
orientation. Thus each pilot will receive 4 hr of training in 
the classroom and 5 hr in the simulator, and an additional 
1-2 hr will be spent for debriefings and filling out 
questionnaires. 
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HUD TYPE n CONFORMAL DISPLAY 


Introduction 

Display elements of the Type II HUD are intended to 
provide complete flight guidance and navigation informa- 
tion, as well as situation data, for terminal-area maneuver- 
ing, landing, and go-around. 

General Description 

The display field of view is 24° wide and 21° high. The 
field is horizontally symmetrical about the aircraft’s longi- 
tudinal axis but is depressed 5.5° in the vertical plane. 
Being designed as “conformal,” some elements of the dis- 
play overlap earth references and move at the same angular 
scaling as the outside visual references. A primary feature of 
the display is a velocity-vector symbol that provides an 
instantaneous indication of the aircraft’s flightpath. Addi- 
tional elements include altitude, airspeed, horizon, pitch 
ladder, glide-slope and localizer bars, heading scale, airplane 
symbol, synthetic runway, speed-error tape, and a potential 
flightpath marker. 


Sensor Requirements 

The basic display is designed to be operated by electrical 
signals from an air-data system. Signals representing indi- 
cated airspeed, true airspeed, barometric altitude, and alti- 
tude rate are required. Navigational information displayed 
can include ILS glide slope and localizer (or VOR), marker 
beacon, radio altitude and distance measuring equip- 
ment (DME). 

Manual settings available to the display computer 
include: 

Runway headings 
“Target” airspeed 
Field altitude 

“Reference” altitude (assigned, MDA, or DH) 

ILS glide-slope angle 


Aircraft Fixed Elements 

Those display elements fixed with reference to the 
“frame” of the display (and to the aircraft axis) are shown 
in figure 27 and are as follows: 

1 . Aircraft reference symbol 

2. DME reading 

3. Marker-beacon passage annunciation 

4. “Limit angle-of-attack line” 


Attitude References 

The presentation of roll, pitch, and heading for the case 
when the runway heading (localizer heading) is displayed is 
shown in figure 28 for an angle of bank of 6° , a pitch angle 
6° above the horizon, and a heading of 087°, 3° off the pre- 
set runway heading of 090°. The 5° and 10° interval 
markers (above the horizon) are centered laterally about 
the aircraft-reference symbol, but the 1° markers above the 
horizon and the attitude reference below the horizon are 
centered laterally about the runway-heading indication. If 
the difference between aircraft and runway heading is 
greater than 9°, these latter references are centered laterally 
about a point on the horizon ±9° from the aircraft heading 
(see fig. 29). If “within ILS tolerance” conditions (defined 
later in the sections on VOR/Localizer Navigation ILS 
Glide Slope) are satisfied, the attitude references below the 
horizon do not appear. 

Flightpath Symbol Array 

As previously indicated the display features a symbol 
that defines the direction of the instantaneous flightpath of 
the airplane relative to the longitudinal axis of the airplane 
and to inertial (earth) references. This symbol is intended 
for use as the primary controlled element of the display, 
thus enabling the pilot to control directly his longitudinal 
flightpath and track rather than indirectly control it 
through the more conventional control of pitch attitude 
and heading. In order to take advantage of the flexibilities 
inherent in a CRT conformal display, speed and altitude 
display elements are arrayed with the flightpath symbol to 
minimize the visual field encompassing all the continuously 
controlled flight parameters. The flightpath symbol and 
related elements are shown in figure 30, and they are shown 
in the context of aircraft attitude in figure 3 1 . 

Flightpath symbol— As illustrated in figure 30, this dis- 
play element is a circle with “wings” deflected 30° down 
from the horizontal and terminating in short horizontal 
“wing tips.” The center of the circle defines the direction 
of the flightpath. The symbol remains fixed in roll with 
reference to the aircraft. 

Indicated airspeed- A digital presentation of indicated 
airspeed is located outboard and below the left “wing tips” 
of the flightpath symbol. Upon interrogation, the digits will 
indicate target speed. 

Speed error- The deviation in indicated airspeed from a 
preset target speed is displayed by a tape, or “worm”, 
extending vertically from the left tip of the flightpath 
symbol, upward for “fast,” at a scaling of 1° subtended 
visual angle for 4 knots error. If speed is more than 5 knots 
below target, the tape is flashed at 4 cycles/sec. 
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Acceleration along flightpath— Referenced to the left tip 
of the flightpath symbol is an indication of the longitudinal 
rate of change in the speed of the aircraft. The signal used 
to drive this symbol combines, by complementary filtering, 
inertial acceleration (high frequency) and rate of change of 
indicated airspeed (low frequency). Appropriate scaling of 
the deflection of this symbol (approximately 3° subtended 
angle per knot per sec) allows its interpretation as an indica- 
tion of the flightpath angle that could be maintained, at 
constant speed, at the aircraft’s current thrust and config- 
uration. Earlier mechanizations of this concept have been 
termed “potential flightpath.” 

Altitude- A digital readout of altitude is located to the 
right of and below the right tip of the flighpath symbol. 
Upon interrogation the digits will read target altitude. The 
digital readout represents main-gear altitude above the ter- 
rain when this value is less than 200 ft; otherwise the digits 
represent altitude above the runway, derived from air data 
reflecting barometric altimeter setting and on input value of 
runway altitude. When the aircraft altitude is within 30 ft 
of the target altitude, the digits flash at 4 cycles/sec. 

VOR/Localizer Navigation 

Aircraft position relative to the approach course is indi- 
cated by the symbol shown in figure 32. The distance from 
the course is proportional (at a given range from the 
station) to the horizontal distance between the reference 
heading and the symbol segments shown. In the example, 
the aircraft is left of course and on a converging heading. 
This symbol is fixed vertically with reference to the hori- 
zon, its center element depressed below the horizon by an 
angle equal to the ILS gUde-slope angle. Lateral deflection 
of the symbol is limited to ±11° from the reference axis of 
the display. If the difference between aircraft and reference 
heading is greater than 9°, or if the localizer error is greater 
than 2.5°, a “course-hne” symbol appears (see fig. 33). 
This line originates at the horizon, ±9° from the aircraft 
heading, and is deflected right or left from the perpendicu- 
lar to the horizon proportionally to the displacement from 
course. In the case shown, the aircraft is converging on a 
090° course on a heading of 075°. If the heading were 
maintained, the “localizer” symbol would move from left 
to right, seeking its zero-error position coincident with the 
runway-heading indication (out of view to the right), and 
the “course line” would swing toward the perpendicular to 
the horizon that would be seen at course crossing. 


ILS Glide Slope 

In figure 34, the indication of error from the ILS glide 
slope is added in the form of a small circle and two horizon- 
tal line segments centered laterally on the localizer symbol. 


Error from the ILS glidepath is proportional (at a given 
range from the station) to the vertical distance between the 
“glide-slope symbol” and its zero-error reference defined 
by the center of the localizer symbol and the four short 
dashes previously identified. If the aircraft is below the ILS 
glidepath, the glide-slope symbol appears above the 
reference. 


Runway Symbol 

ILS data and the altitude above the runway are used to 
define the shape and position of a symbolic representation 
of the runway. This symbol will overlay the runway as seen 
in VMC. In figures 35 and 36, several configurations of 
combined ILS and runway symbols are shown, representing 
different positions of the aircraft relative to the ILS 
approach path. These sketches are intended to demonstrate 
the objective of the logic and scaling of the localizer and 
glide-slope symbols. In perspective, as an analog of an 
exterior view, the intersection of these symbols (denoted 
by the circle) can be visualized as an object on the ILS 
approach path some distance ahead of the viewer’s aircraft. 
In figure 37, the flightpath symbol array is added to illus- 
trate the normal mode of flying an ILS approach. If the 
flightpath of the aircraft is maintained and directed at the 
intersection circle, a pursuit course, converging on the ILS 
path, will be flown. The ultimate result will be the condi- 
tion illustrated in figure 38, in which the viewer’s aircraft 
can be perceived as being in trad behind the circle on the 
ILS path toward the runway. 


Reference-Altitude Symbol 

In HUD configurations not displaying ILS gUde-slope 
information, the symbol illustrated in figure 39 is avadable 
for use to annunciate and capture a preselected target alti- 
tude. The distance of the symbol below the horizon is pro- 
portional to the aircraft’s altitude above the reference 
altitude. In the illustration, the aircraft is descending on a 
5° flightpath ("^1000 ft/min) toward a target altitude 
(MDA) of 450 ft. Tracking the symbol with the flighpath 
symbol wdl result in a flare to level flight at 450 ft. Again 
the analogy of flying in trad behind another aircraft is seen, 
but this time it is in level flight. 


Ground-Proximity Symbol 

A symbol simdar in geometry and operating principle to 
the reference-altitude symbol is provided as a landing-flare 
guide. In this case, the symbol is displayed below the hori- 
zon a distance proportional to a radio altitude measurement 
of the main-gear height above the runway. In figure 40, the 
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symbol is shown rising from the bottom of the display as 
flare altitude is approached. In figure 41 , the “flare” sym- 
bol is being tracked shortly before touchdown. 


REVIEW OF MAJOR DISPLAY ELEMENTS 


The major display elements can be divided into four gen- 
eral categories or elements: conformal elements bearing a 
one-to-one relationship and scaling to specific earth refer- 
ences; advisory elements that show certain relationships 
with the outside world; reference elements that provide 
general relationships within the display; and lastly, the 
dynamic and controllable elements. 


Conformal Elements 

Conformal display elements, or elements that match the 
real world in shape, size, and movement, include the 
following 

1 . Artificial horizon that overlays the real horizon and 
pitch, roll, and heading information. 

2. Heading scale (combined with the artificial horizon). 

3. Glide slope (only partially conformal). In initial 
stages of glide-slope capture it provides pitch-position 
information. Once on the glide slope, it helps to define (and 
wiU overlay) the touchdown zone on the runway. 

4. Localizer (only partially conformal). Initially the 
localizer provides right or left steering reference; it is coinci- 
dent with runway centerline only after localizer capture. 

5. Runway symbol (fuUy conformal with real-world 
runway at all times). This symbol matches the real runway 
in size and pictorial orientation. 


Advisory Elements 

Advisory elements can be further divided into two 
classes: those that provide primarily cognitive information 
such as DME, marker beacon, speed error, altitude refer- 
ence, acceleration marker, and airspeed reference; and those 
that provide spatial or geographic orientation, including 
heading scale, glide slope, localizer, and flare command. 


Reference Elements 

Elements that primarily provide spatial reference and 
have a stadimetric relationship to the outside world 
include the pitch ladder and fixed-depression references. 
To a certain extent the heading scale and horizon bar can 
be included in these elements. These references provide an 
aiming point in space at which to direct or aim the aircraft 
symbol and/or velocity vector. Pitch-ladder references start 
with positive pitch marks at 3° and progress every degree 
up to 20®. Major index marks are located at 10® and 20®. 
Negative pitch is defined by pairs of minor tick marks 
centered on either side of the reference heading and located 
at -5® and 10®. At -2.75®, and also centered on the refer- 
ence heading, is a fixed depression line that is set at the 
glide-slope reference. (In the display shown, it is set at 
-2.75®, but it can be set to any desired glide-slope 
reference.) 


Dynamic Elements 

The dynamic elements referred to herein are those 
directly controlled or controllable by the pilot. These ele- 
ments include the aircraft symbol, velocity vector, speed- 
error tape, and the acceleration marker. In each case, the 
symbol is directly responsive to a pilot control input such 
as pitch or roU commands, or a change in throttle position. 


Head Up and Head Down 

Further review of display elements is provided in fig- 
ures 42(a) and (b), 43(a) and (b), and 44(a) and (b). Each 
figure shows both the head-up and head-down display of 
the same information. In figure 42(a) the aircraft is at 
approximately 500 ft altitude, airspeed 135 knots, on 
glideslope, and slightly to the right of the localizer. Fig- 
ure 42(b) shows the same information on the head-down 
instrument panel. (Minor variations between the head-up 
and head-down display readings is the temporary result of 
simulator display drive signal calibration errors.) Figures 43 
and 44 provide similar comparisons with the aircraft at 
100 ft and the runway in sight, and at touchdown. 


SAMPLE PROBLEMS 


In this section are presented sample situations as depic- 
ted on the head-up display (HUD), For each situation, a set 
of initial conditions or constraints is given, and the pilot is 
asked to analyze the display and recommend corrective 
action, if necessary. 
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Situation A 

Situation as follows: 

1. Reference airspeed: 170 knots 

2. Altitude: 1400 ft 

3. ILS approach 

4. Outer marker at 4.5 DME 

5. Runway heading: 090° 

6. Visibility: 4000 ft 

7. Ceiling: 250 ft 

8. Winds: calm 

The pilot’s instructions from ATC were to maintain 
170 knots to the outer marker for aircraft separation. The 
glide slope angle is 2.75°. 

Refer to figure 45 and circle the correct answer in 


the following: 





1. Airspeed: 

Fast 

Slow 

On 

Unknown 

2. Altitude: 

3. Aircraft 

High 

Low 

On 

Unknown 

relative to 
localizer: 

Right 

Left 

On 

Unknown 

4. Aircraft 





relative to 
glide slope: 

High 

Low 

On 

Unknown 

5. Flightpath: 

Climbing 

Descending 

Level 

Unknown 

6. Acceleration: Positive 

Negative 

Zero 

Unknown 


4. Flightpath: Climbing Descending Level Unknown 

5. Acceleration: Positive Negative Zero Unknown 

Based on your analysis of the display, what corrective 
action, if any, would you take and why? Do you have suf- 
ficient information for analysis? If not, what additional 
information do you require? 

Situation C 

You are making a nonprecision approach to a runway 
heading of 090°, with an MDA of 450 ft, DME at the MAP, 
airport visibility of 7500 ft, and a ceiling of 600 ft. The 
reference airspeed is 135 knots. Refer to figure 47 and 
circle the correct answer in the following: 


1. Airspeed: 

Fast 

Slow 

On 

Unknown 

2. Altitude: 

High 

Low 

On 

Unknown 

3. Heading; 

Right 

Left 

On 

Unknown 

4. Flightpath: 

Ascending 

Decending 

Level 

Unknown 

5. Acceleration: Positive 

Negative 

Zero 

Unknown 


Based on your analysis of the display, what corrective 
action, if any, would you take and why? Do you have suf- 
ficient information for analysis? If not, what additional 
information do you require? 


Based on your analysis of the display, what corrective 
action, if any, would you take and why? Do you have suf- 
ficient information for analysis? If not, what added infor- 
mation do you require? 


Situation B 

Initial conditions are: 

1. Reference airspeed: 135 knots 

2. ILS approach 

3. Runway heading: 090° 

4. Visibility: 4000 ft 

5. Ceiling: 250 ft 


Refer to figure 46 and circle the correct answer in 
the following: 


1. Airspeed: 

2. Aircraft 

Fast 

Slow 

On 

Unknown 

relative to 
glide slope: 

High 

Low 

On 

Unknown 

3. Heading: 

Right 

Left 

On 

Unknown 


CREW PROCEDURES 


Crew procedures practiced by major airlines for similar 
aircraft are modified and generalized for this study. The air- 
craft being simulated is the Boeing 727. However, the flight 
engineer’s position is not simulated. The crew for this study 
is a captain, a copilot, and an observer. The observer will 
not function as part of the flying crew. 


Pilot Duties 

In all experimental cases, the left-hand seat will be 
occupied by the captain, the flying pilot for all experimen- 
tal runs. The general duties of the captain require that, once 
the simulator is placed in “operate,” he will fly the pre- 
scribed profile as given by the simulated air-traffic control- 
ler and terminate his flight with either a landing or a go- 
around, whichever is appropriate. The captain will ask the 
copilot to go through the final-descent checklist and 
handle landing gear and flaps. The captain will be assisted 
by the copilot only “as requested.” 
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Copilot Duties 

The copilot for all experimental runs wiU be an Ames 
employee. As copilot he will make flap and landing-gear- 
handle settings at the pilot’s request. He will monitor air- 
speed, altitude, and aircraft attitude during final approach 
and make callouts as prescribed in the summary that 
follows. At the captain’s request he will initiate and com- 
plete the final-descent checklist. He will respond to ATC 
communications and will inititate ATC communication at 
the captain’s request. 


SUMMARY OF FLIGHT-CREW PROCEDURES FOR 
HUD PHASE 111 


Captain (Pilot Flying) 

The captain wiQ determine the approach target speed by 
using Vj.^f (124 knots at 140,000 lb) plus one half the 
headwind component plus the gust factor. Total add on 
should not exceed 20 knots. 

The captain should caD for landing gear and flaps as 
required. The captain should also request the copilot to 
select desired flight-director modes. 

Standard callouts for the captain are: 

Outer-marker crossing altitude, target speed, mini- 
mums and time to missed approach point (MAP) 
(nonprecision only) 


1000 ft AGL 

100 ft above minimums 

Minimums 

In addition to the standard callouts, the captain should 
verbally announce ground contact, approach lights, or run- 
way threshold as appropriate (HUD approaches only). 


Copilot (Pilot Not Flying) 

The copilot wiU handle all ATC communications and 
operate the landing gear, flaps, and flight-director-mode 
control panel as requested by the captain. 

The copilot should acknowledge all standard callouts by 
the captain. 

The copilot will monitor the approach and will callout 
the following deviations: 

Airspeed deviations in excess of +10 or -5 knots 

Localizer and glide-slope deviations in excess of 
1 dot 

Below 1000 ft above field level (AFL), sink rates in 
excess of 1000 ft/min 

The copilot will monitor time on nonprecision approaches 
and will call out “Missed Approach Point.” 

For head-down approaches, the copilot will announce 
“ground contact, approach lights, runway threshold” 
as appropriate. 
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APPENDIX D 


EXPERIMENTAL DESIGN AND STATISTICAL 
ANALYSIS FAA/NASA HEAD-UP 
DISPLAYS - PHASE III 


Final Report 
J. Michael Steele, Ph.D. 
Control Analysis Corp. 
AprO 14, 1980 


PURPOSE AND STRUCTURE 


The main objectives of this report are (1) to provide a 
description of the experimental design used in the HUD 
Phase III project and (2) to provide a careful statistical anal- 
ysis of the data which was obtained. 

To serve these objectives the report has been divided 
into five sections as follows: 

EXPERIMENTAL DESIGN 

INTRODUCTION TO THE PRINCIPAL ANALYSIS 

HISTOGRAMS AND ANOVA ON 20 FLIGHT 
VARIABLES 

SUPPLEMENTAL ANALYSIS AND CONSISTENCY 
TESTS 

GENERAL CONCLUSIONS 


EXPERIMENTAL DESIGN 


Layer One 


The very important problem of making actual specifica- 
tions of the wind and ceiling conditions will not be discus- 
sed here since they do not impact on the structure of the 
experimental design. These specifications will ultimately 
have importance for the interpretation of the experimental 
results, but for now we content ourselves with noting that 
the conditions Cl , C2, C3 and Wl, W2 have different speci- 
fications under the different headings of Precision 
and Nonprecision. 

The Experimental Design called for each pilot to fly 36 
flights; one flight for each of the 36 cells of table 37. (In 
the actual implementation there were modest amounts of 
missing data. The considerations made for such missing data 
will feature prominently in the detailed data analysis, but 
will not be discussed until the analysis segment.) 

For each of the flights which were simulated a large 
number of continuous and window measurements were 
made. For the purpose of analysis these data were com- 
pressed into 41 response statistics; the 29 most important 
are considered in the present analysis. Since some under- 
standing of these is necessary before discussing the second 
level of the Experimental Design, these response statistics 
are listed below in their natural groupings. 


Any experimental design as complex as that employed in 
HUD Phase III is best understood (and best analyzed) in 
layers. The first layer in HUD Phase III consists in under- 
standing the flight situations which were flown by every 
pilot. These situations can be easily visualized in terms of 
the cells of the following table 37. 

As an introduction to the table one should note that 
HUDl, HUD2, HUD3 refer to the three types of displays 
under study. The headings Cl and C2 denote two types of 
ceiling conditions and Wl, W2, W3 denote three types of 
wind condition. The principal headings Precision and Non- 
precision effectively divide the whole study into two 
separate studies. 


VARIABLES TO BE STUDIED 


Outer Marker 
OMALT 
OMYCG 
OMVQVR 

Approach segment 
ALOC AEASD 
AGS AHDOTMAX 
AEASM AHDOTM 

AHDOTD 


Intercept 

lALT 

IVQVR 


Flare segment 
FALT FVQVR 

FYCG FHDOT 


Landing segment 
LXCG LMAXVEQ 

LYCG LMAXHDOT 
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NAME 

DESCRIPTION 

UNITS 

OMALT 

Altitude at the outer marker 

ft 

OMYCG 

Aircraft lateral displacement from 
runway centerline extended 

ft 

OMVQVR 

Speed error from “bug” at outer 
marker 

knots 

lALT 

Mean altitude during intercept 
segment 

ft 

IVQVR 

Mean error from bug during 
intercept segment 

knots 

ALOC 

RMS localizer error during 
approach segment 

deg 

AGS 

RMS glide slope error during 
approach segment 

deg 

AEASM 

Mean airspeed during approach 
segment 

knots 

AEASD 

RMS deviation of airspeed from 
mean airspeed during approach 
segment 

knots 


NAME 

DESCRIPTION 

UNITS 

LMAXHDOT 

Maximum sink rate at touchdown 

ft/sec 

OMHDOT 

Mean sink rate at the outer marker 

ft/sec 

MMALT 

Altitude at the middle marker 

ft 

MMYCG 

Lateral error from runway center- 
line extended at middle marker 

ft 

MVQVR 

Airspeed error from “bug” at 
middle marker 

knots 

MMHDOT 

Mean sink rate at middle marker 

ft/sec 

IMALT 

Altitude at inner marker 

ft 

IMYCG 

Lateral error from runway center- 
line extended at inner marker 

ft 

IMVQVR 

Airspeed error from “bug” at 
inner marker 

knots 

IMHDOT 

Mean sink rate at inner marker 

ft/sec 


Level Two 


AHDOTMAX Maximum sink rate during 
approach segment 

ft/sec 

AHDOTM 

Mean sink rate during approach 
segment 

ft/sec 

AHDOTD 

RMS deviation of sink rate from 
mean sink rate during 
approach segment 

ft/sec 

FALT 

Altitude at the runway threshold 

ft 

FYCG 

Lateral error from runway center- 
line at threshold 

ft 

FVQVR 

Airspeed error from “bug” at 
threshold 

knots 

FHDOT 

Sink rate at threshold 

ft/sec 

LXCG 

Touchdown distance from 
threshold 

ft 

LYCG 

Touchdown distance from run- 
way centerline 

ft 

LMAXVEQ 

Maximum airspeed at touchdown 

knots 


The task at the second level of the experimental design is 
to understand those factors which are not the same for each 
pilot. There are two such factors: the level of air traffic 
control (ATC) communications and the presence 
of anomalies. 

The ATC level is the easier of these two factors to 
explain. There were three levels of ATC in the experiment, 
and their exact specification (although important) is 
unessential to the structure of the design. The levels are 
denoted simply as ATC level 1,2, and 3, and these are pre- 
cisely the numbers which occupy the cells of table 37. The 
pattern of ATC levels differs from pilot to pilot, but this is 
done in such a way that each flight condition (P/N, HUD, 
C, W) occurs precisely 4 times under each of the three 
ATC levels. 

The conceptually more interesting factor which is met at 
level two is that of the “anomaly.” The basic idea was that 
any choice in Display must be measured in some way to see 
how it influences the appropriateness of response to events 
which require an unusual action. The study design considers 
four conditions for which the accepted practice is a “fly 
around.” Collectively these are called anomalies, and the 
four anomalies considered are wind shear, low ceiling, scud, 
and runway obstruction. 
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The experimental design calls for each pilot to fly six 
flights in which an anomaly is to take place. The anomalies 
which a pilot gets as well as the times he gets them are 
determined by an allocation procedure which is governed 
by chance (an actual rolling of dice). This random alloca- 
tion was conducted subject to the constraints of a 4-day 
week schedule and to minimize the effect of carry-over of 
stress from one flight to the next. 

With the specification of flight condition, anomaly type 
(possibly none) and ATC level the specification of all 
factors to be analyzed by the study is complete. 

INTRODUCTION TO THE PRINCIPAL ANALYSIS 


The main analytical tool used in the present analysis was 
the one-way analysis of variance performed by BMDP7D. A 
key benefit of this package is that it also provides histo- 
grams which are an essential check on what the F-ratio is 
actually revealing. 

The purpose of the following table is to provide sum- 
mary information for the full analyses given in the next sec- 


TABLE OF SIGNIFICANCE 


Variable 

Significance Level 

Precision 

Nonprecision 

OMALT 

0.0003** 

0.4190 

OMYCG 

.9243 

.0626 

OMVQVR 

.8050 

.0450* 

lALT 

.6808 

.2638 

IVQVR 

.1071 

.0964 

ALOC 

.0179* 

.0000** 

AGS 

.0000** 

.0098** 

AEASM 

.2561 

.3639 

AEASD 

.6341 

.8383 

AHDOTMAX 

.0000** 

.4508 

AHDOTM 

.0396* 

.0000** 

AHDOTD 

.0000** 

.8670 

FALT 

.0337* 

.0000** 

FYCG 

.2879 

.1165 

FVQVR 

.2142 

.0359* 

FHDOT 

.0067** 

.0000** 

LXCG 

.0607 

.7120 

LYCG 

.2796 

.6894 

LMAXVEQ 

.0618 

.0078** 

LMAXHDOT 

.1437 

.0128** 


NOTE: The symbols * and ** are used here, as tradi- 
tionally, to bring attention to levels beyond the 0.05 and 
0.01 significances, respectively. 


tion. The first message provided by this table is that in 
terms of the variables measured in this study there are large 
and statistically significant differences in the three displays. 
By looking first at those variables which show very low 
F-probabilities (very high significance), a picture quickly 
emerges of the differing effects of the displays. For an 
understanding of the engineering or planning impact of 
these differences, the histograms of the next section pro- 
vide considerable assistance. 


HISTOGRAMS AND ANOVA ON 
20 FLIGHT VARIABLES 


The tables of this section contain the heart of this 
report. Each table has its own message in addition to the 
basic measure of differences given by significance level. The 
presence of out-liers, the possibility of patterns, and a 
visual check on reasonability are all part of the benefits 
given the histograms. It is also important to make system- 
atic note of the difference of means. 

The tables are first given for all the 20 precision variables 
and then for all the 20 nonprecision variables. The order of 
the tables is the same as on the previous table of signifi- 
cance levels. In fact, that tables serves as a useful table of 
contents for this section. 

As a matter of notation, one should note that the three 
displays are labelled HUDPl, HUD2, HUD3,. under pre- 
cision conditions and HUDNl, HUD2, HUD3 under non- 
precision conditions. 
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ITABULATION OF VARIABLE 


2 OMALT 


HUDPl HUD2 HUBS 

+ + + + + 

MIDPOINTS 

2120*000) 

2080.000) 

2040.000) * 

2000.000) 

1960.000) 

1920.000) 

1880.000) 

1810.000) * 

1800.000) 

1760.000) 

1720.000) ♦ 

1680.000) * 

1640. 000 ) 

1600.000) 

1860.000)*** * ** 

1520 .000) ********* ***** * 

1480.000) M*******19 *** ***** 

1440. 000) ********15 M*******2:J H*******12 

1 <100 .000 ) ********* ********22 **'*'*****31 

1360.000) * **** ******* 

1320.000) 

1 280 . 000 ) 

GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH *'S» N'S OTHERWISE 


HEAN 

1479.117 1429.238 

1429.813 

.000 

.000 

.000 

S. DEV. 

91.903 43.396 

78.741 

.000 

.000 

.000 

U 

59.000 58.000 

60.000 

.000 

.000 

. 000 

MAXIMUM 

2041.000 1541.000 

1853.000 

.000 

.000 

.000 

MINIMUM 

1374.000 1349.000 

1359.000 

.000 

.000 

.000 

GALL GFsGUPS COMBINED (CASES EXCLUDED IF SPECIAL 

CODES FOR 

EITHER 

VARIABLE) 

V 

OMEAN 

1445.871 





S. DEV. 

77.467 





N 

176. 





MAXIMUM 

2041 .000 





MINIMUM 

1349.000 






SUM OF SQUARES D- 

MEAN SQUARE 

F RATIO 

PROB. F 

EXCEEDED 

BETWEEN 

95626.8750 2 

47813.4375 

B.66Z3 

.0003 

WITHIN 

954582.5000 173 

5517.8164 




TOTAL 

1050209.0000 175 
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ITABJ/LATION OF •JAfilABLE 


3 OMYCG 


HUDPl HUD2 

+ 

MIDPOINTS 

2400.000) 

2200 . 000 ) 

2000,000) 

1800.000) 

1600.000) 

1400.000) 

1200.000) 

1000 . 000 ) ♦ 

800.000) 

600,000)* 

400.000) *** 

200 .000) ********13 ********1 1 
,000)M****»**26 M»******40 

- 200 . 000 )********!! #**♦ 
-400.000)** * 

-600.000)* 

-800.000)* 

1000,000) 

1200,000) 

1 400 . 000 ) 

1 600 . 000 ) 

1800.000) * 

GROUP MEANS ARE DENOTED BY M'S 


HUD3 

•i- + -f 


* 


** 


**** 

********11 

M*******22 

**.****•**14 

**** 

* 

« 


IF THEY COINCIDE WITH *'Sr 


+ 


N'S OTHERWISE 


MEAN 

9.224 

.017 

23.033 

.000 

.000 

.000 

S. DEV. 

225.283 

300.143 

399.309 

.000 

.000 

.000 

N 

58.000 

58.000 

60 . 000 

.000 

.000 

.000 

MAXIMUM 

519.000 

1035.000 

2033 . 000 

.000 

.000 

.000 

MINIMUM 

-827.000 

-1823.000 

-1058.000 

.000 

.000 

.000 

OALL GROUPS COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


0 

OMEAN 
S. DEV. 
N 

MAXIMUM 

MINIMUM 


10.898 
315. 78S 
176. 

2053.000 

-1825.000 


SUM OF SQUARES DF 
BETWEEN 15865.2344 2 
WITHIN 7435216.0000 173 
TOTAL 7451072.0000 175 


MEAN SQUARE F RATIO PROB. F EXCEEDFD 
7932.6172 .0787 .9243 

100781.5625 
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ITABULATION OF VARIABLE 


A OMVQVR 


HUDPl HUD2 HUD3 

MIDPOINTS 

42.000) 

39.000) 

36.000) 

33.000) 


30.000) * 

27.000) * 

24.000) ** 

21 . 000 ) * * * 

18.000)** ** 

15.000) ** * 

12 . 000 ) *** *** ***** 


9.000) ********11 ********13 ********** 

6 .000) M******** M****.***ll M*.******ll 

3 . 000 ) ********12 ********12 ********14 
, 000 )********** ********** ********** 

-3 ,.000)***** **** *** 

- 6 . 000 )* #* * 

-9.000) * 

- 12 . 000 )* 

-15,000) 

-18.000) 

- 21 , 000 ) 

GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH t'Sf N'S OTHERWISE 


MEAN 

5.226 

4,936 

5.717 

.000 

.000 

.000 

S. DEV. 

6.861 

5.556 

7,000 

.000 

.000 

.000 

N 

58,000 

58.000 

60.000 

.000 

.000 

.000 

MAXIMUM 

28,400 

20.200 

29.600 

.000 

.000 

.000 

MINIMUM 

-11.500 

-5.100 

-9 . 100 

.000 

.000 

.000 

CALL GROUPS 

COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


OMEAN 5.298 

S. DEV. 6.481 

N 176. 

MAXIMUM 29.600 

MINIMUM -11.500 

SUM OF SQUARES 
BETWEEN 18.4108 

WITHIN 7332.9805 

TOTAL 7351.3906 


Df- MEAN SQUARE F RATIO PROB. F EXCEEDED 
2 9.2054 .2172 .8050 

173 42.3872 

175 
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1 TABULATION OF VARIABLE 


2 lALT 


HUDPl 


HUD2 


HUBS 


MIDPOINTS 

3100.000) 

3000.000) 
2900. 000 > 

2500.000) 

2700.000) 

2600.000) 

2500.000) 

2400.000) 

2300 .000) 

2200 . 000 ) * 
2100 . 000 ) 
2000 . 000 ) 

1900.000) * 

1800.000) ** 

1700.000)** 


** 


*# 

* **** 
16O0.qO0)M*******12 M*******14 ****** 

1500 .000) ********24 ********28 M*:******34 

***** 


1400.000) *** 

1300.000) 

1200.000) 

1100.000) 

GROUP MEANS ARE nENOTED BY 


** 


S IF THEY COINCIDE UITH *'Sf N'S OTHERWISE 


MEAN 
S. DEU. 
N 

MAXIMUM 

MINIMUM 


1563.531 

139.947 

45.000 

2218.000 

1436.000 


OALL GROUPS COMBINED 
0 


1566 . 644 

1542.373 

.000 

.000 

.000 

207.978 

121.470 

.000 

.000 

.000 

51 .000 

48.000 

.000 

.000 

.000 

2902 . 000 

2027.000 

.000 

.000 

.000 

1396.000 

1431.000 

.000 

.000 

.000 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


OMEAW- 
S, DEU. 
N 

MAXIMUM 

MINIMUM 


1559.143 

161.685 

144. 

2902.000 

1396.000 


SUM OF SQUARES 
BETWEEN 20335.3086 
WITHIN 3717962.0000 
total 3738297.0000 


DF 

2 

141 

143 


MEAN SQUARE 

10167,6523 

26368.5234 


F RATIO 
.3856 


PRQB . 


F EXCEEDED 
6808 
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1 TABULATION OF VARIABLE 


3 IVCIVR 


HU DPI 


MIDPOINTS 

40.000) 

36.000) 


HUD2 HUD3 

+ 


+ 


+ 


32.000) 


23.000) 

24.000) ** 

20 . 000 ) * 
16.000)#*** 
12 . 000 )******* 

a . 000 ) M*******i 1 
4 . 000 ) ******** 1 1 


* 

« 

*** 

****** 

********15 

M******* 


. 000 )********* *****#.**12 


-4.000) 

- 8 . 000 ) 

- 12 . 000 ) 

-16.000) 

- 20 . 000 ) 

-24.000) 

-23.000) 

-32.000) 

-36.000) 

-40,000) 

GROUP MEANS ARE 


* 

*** 

* 

DENOTED BY M'S 


*** 

**** 

* 

**** 

M******#l 1 
********17 
***** 

* 

* 

« 


IF THEY COINCIDE WITH *'S» 


+ 


N'S OTHERWISE 


MEAN 

7.562 

4.863 

8.012 

.000 

.000 

.000 

S. DEV. 

6,129 

8.194 

9.143 

.000 

.000 

.000 

N 

45.000 

51,000 

48,000 

,000 

.000 

.000 

MAXIMUM 

23.700 

22.900 

30.000 

.000 

.000 

.000 

MINIMUM 

-.900 

-30.500 

-10.900 

. 000 

.000 

,000 

OALL GROUPS COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES FOR 

EITHER 

VARIABLE) 


0 


OMEAN 
S. DEV, 
N 


6.756 

8.032 

144, 


MAXIMUM 30.000 

MINIMUM -30.500 



SUM OF SQUARES 

DF 

BETWEEN 

287.8369 


WITHIN 

8938.6133 

141 

TOTAL 

9226,4492 

143 


MEAN SQUARE F RATIO 
143.9185 2.2702 

63.3944 


PROB. F EXCEEDED 
. 1071 
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1 TABULATION OP UAKIABLE 


4 ALOC 


HUDPl 


MIDPOINTS 

1.260) 

1.190) 

1 . 120 ) 

1.050) 

.980) 

.910) 

.840) 

.770) 

.700) 

,630) 

.560) 


HUD2 

+ . . * . 


* 


.490)* 

.420)* 

.350)* 


.280)** 

. 210 )*** * 

. 140)M*******15 ********* 


HUD3 

"h . ♦ . . 


* 

* 

* 

**** 


+ 


+ . . + 


.070) ********20 M*****.**30 M*******20 
-. 000 )** ********** ********21 
-.070) 

-.140) 

npOUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH *'S» N'S OTHERWISE 


MEAN 

.132 

.093 

.064 

.000 

.000 

.000 

S. DEV. 

.093 

.149 

.080 

.000 

.000 

.000 

N 

45.000 

51.000 

48.000 

.000 

.000 

.000 

MAXIMUM 

.520 

1.090 

.390 

.000 

.000 

.000 

MINIMUM 

.030 

.010 

.010 

.000 

.000 

.000 

CALL GROUPS 

COMBINED 

(CASES EXCLUDFD IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE 


0 


OMEAN 
5. DEV. 
N 

MAXIMUM 

MINIMUM 


.096 
.116 
144 . 
1.090 
,010 



SUM OF SQUARES 

DF 

MEAN SQUARE F RATIO 

PROD. F EXCEEDED 

.BETWEEN 

.1076 

2 

.0538 4.1397 

.0179 

WITHIN 

1.8329 

141 

.0130 


TOTAL 

1.9405 

143 
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ITABULATION OF VARIABLE 


2 AGS 


HUDPl HUD2 HUri3 

+ + ....♦ . . . 

MIDPOINTS 
. 570 ) 

.540) 

,510)* 

.400) 

.450) 

.420) 

.390) 

.360) 

.330) ♦ 

.300) 

.270)* 

.240)# * 

, 210 )** * # 

.180)**** * 

.150)* 

. 120>M******* **** 

,090 )******** 13 ******** *♦** 

.060) ********11 f1***>***iS M*******H 
.030)*** ********19 *>::**4***28 

. 000 ) ** 

-.030) 

■KOUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH *'Gr 


+ 


N'S OTHERWISE 


MEAN 

.114 

*065 

• 051 

• 000 

.000 

. 000 

S . DEV . 

.081 

.OAA 

• 056 

• 000 

.000 

,000 

N 

45.000 

51*000 

48*000 

• 000 

,000 

. 000 

MAXIMUM 

.510 

• 250 

• 320 

• 000 

.000 

.000 

MINIMUM 

.030 

• 020 

• 010 

• 000 

,000 

.000 

GALL GROUPS 

COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


0 

OMEAN ..076 

S. DEV. .066 

N 144.. 

MAXIMUM .510 

MINIMUM .010 

SUM OF SQUARES 
BETWEEN .1009 

WITHIN ..5300 

TOTAL ,6309 


DF MEAN SQUARE F RATIO PROB. F EXCEEDED 
2 .0505 13.4274 .0000 

141 ,0038 

143 
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ITAiiULATION OF VARIABLE 


3 AEASM 


HUDPl 


HUD2 


HUD3 


MIBF:-0INTS 
J 56.000) 

1 5') , 500 > 

153.000) 

151 .500) * 

150.000) 

1413.500) 

147.000) **** 

145.500) *** 

144.000) * 

142.500) ** 

141 .000) ***» 

139.500) * 

130.000) M***** 

136 . 500 ) ****** 

135'. 000 ) ******** 

133.500) **** 

132.000) 

130.500) *** 

129.000) ** 

] 27 . 500 ) 

126.000) 

GROUP MEAUS ARE DENOTED BY 


** 

** 

«** 

******* 

*** 

M**** 

********11 

********* 

******* 

« 


* 

* 

« 

** 

** 

*«* 

*** 

****** 

M****** 

***** 

********11 

***** 

« 


IF THEY COINCIDE WITH t'S? N'S OTHERWISE 


MEAN 

138.192 136.709 

S. DEV. 

5.395 4.068 

N 

45.000 51.000 

MAXIMUM 

151.760 149.280 

MINIMUM 

128.860 130.540 

>ALL GROUP-: 

5 COMBINED < CASES EXCl.1 

• MR AN 

137.279 

S. DEV. 

4.568 

N 

144. 

MAXIMUM 

151.760 

MINIMUM 

128.860 

SUM OF SQUARES DF 

BETWEEN 

57.1027 2 

WITHIN 

2926,8982 141 

total 

2984,0007 143 


137.029 .000 

4.174 ,000 

48.000 .000 

148.320 .000 

130.930 .000 

iED IF SPECIAL. CODES 


FOR 


.000 

.000 

.000 

.000 

.000 

EITHER 


,000 
.000 
.000 
. 000 
. 000 
VARIABLE) 


MEAN SQUARE 
28.5513 
20.7501 


F RATIO 
1.3754 


PROB. F EXCEEDED 
.2561 
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ITABULATION OF VARIABLE 


4 AEASIi 


HUDPl HUD2 HUD3 

,» + + + + + 


MIDPOINTS 

16.000) 

15.000) 

14.000) 

13.000) 

12 . 000 ) 
11 . 000 ) 
10 . 000 ) 

9.000) 

8 . 000 ) 

7 . 000 ) 

A . OO " ^ ** 


* 


* 

ttt*. 


4 

3 

*:> 

1 

-1 

-3 

-4 


000)**» 

**** 

000 ) *;****♦. Xc* 

*** 

000)M*****Xt*15 

M*******l 

000)*******XC14 

X!*******! 

000)*** 

***X(*** 

000) 


000) 


000) 


000) 


000) 





* 

* 

***•*♦♦ 
M*******l 1 
Xt******-^ 1 7 


GROUP MEANS 

ARE DENOTED BY 

M'S 

IF THEY COINCIDE 

WITH 

*'St N'S OTHERWISE 

MEAN 

3.002 3. 

044 

2.775 

.000 

.000 

♦ 000 

S. DEV. 

1.1S2 1. 

786 

1.408 

.000 

.000 

♦ 000 

N 

45.000 51. 

000 

48.000 

.000 

.000 

• 000 

MAXIMUM 

6.410 10. 

140 

7.370 

.000 

.000 

♦ 000 

MINIMUM 

1.270 

740 

.540 

.000 

.000 

♦ 000 

CALL GROUPS COMBINED (CASES 

EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

UARIABLE) 

V 

OMI.AN 

2.941 






S. DEV. 

1.487 






N 

144 . 






MAXIMUM 

10.140 






MINIMUM 

.540 






SUM 

OF SQUARES 

DF 

MEAN SQUARE F 

RATIO 

PROD. F 

EXCEEDED 

BETWEEN 

2.0369 

n 

1.0185 

.4571 

.6341 

WITHIN 

314 . 1648 

141 

2.2231 




TOTAL 

316.2017 

143 
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ITAPIJLATION rjF V,-,RIABLE 


2 AHMOlhAX 


HUDPl HUD2 HLIH3 

+ « + + 

MIDPOINTS 

-9.000) 

-10.5001 

-12.000) ********11 

-13.500) ***** ***** 

-15.000)** *#** ****** 

-1A.500)****** ********16 M*******H 

-13.000)****- M***** ******* 

-19.500)****** ****** ***** 

-21 . 000 ) ***** ****** 

-22.5O0)h* *** 

-I?*"?. 000 )****** *** ** 

-25.500)**** * 

-27 . 000 ) ** 

-28.500)* * 

-30 . 000 ) *** 

-7. 1.500)-* 

— 77 , 0<)0 ) * 

-34.500) * 

-3rt.000)** 

- 77,500) 

-79 . 000 ) 

SROIJP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH *'Sf N'S OTHERWISE 

MEAN -22.639 -13.338 -16.232 .000 .000 .000 

S. DEO. 5.429 3.396 3.957 .000 .000 .000 

N 45.000 51.000 48.000 .000 .000 .000 

maximum -14.740 -12.920 -11.390 ,000 .000 .000 

r, IN] Ml lit -36.6S0 -28.720 -34.390 .000 .000 .000 

•>,-.LL GROUPS COMDINED (CASEiiS EXCLUDED IF SPECIAL CODES FOR EITHER VARIABLE) 

i") 

OhEi'iN -19.012 

S. DEO. 5.017 

N 144, 

MAX I HUH -11.890 

h I H I iiUM -36 , 680 

SUM OF SQUAF5ES DF ME-IAN SQUAf^'E-.' F RATIO PROEi. F FXCEFnFD 
BfMWEEN 989,5012 2 494.7505 26.7315 ’ .0000 " 

WITHIN 2609.6462 1>1 13.5081 

TOTAL 3599.1475 143 
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ITAlJlJLf'^TlON OF VARIASLE 


3 AtmOTM 


HUDPl 


MIDPOINTS 

-b'.OOO) 

- 6 . 000 ) 

-7.000) 

-! 3 . 000 ) 


HUD2 

’I* * • • » 


HUD3 

■f ♦ ♦ • • 


+ 


+ 


-9.000)* 



-10.000)** 

******* 

*** 

-11 .000 )******** 12 

********20 


-12.000)******* 

M******* 


-13.000)M**»** 

********** 


-14.000)********* 

«*« 


-15.000)******* 

«* 

t 

-16.000) 

« 


-17.000) 

-18.000) 

-19,000) 


« 

-20,000) 
-21.000)* 
-22.000) 
—23,. 000 ) 

-24.00“ ) 

-25.000) 


t 

iROUP MEANS ARE DENOTED BY M'S 

IF THEY CG INC IDE WITH 


t'Sf 


+ 


N'S OTHERWISE 


MEAN 

-12.S2S 

-11 .904 

-12.260 

*000 

.000 

,000 

S . DEO . 

2.045 

1.417 

1 .819 

*000 

,000 

.000 

N 

45,000 

51.000 

48.000 

*000 

.000 

,000 

MAXIMUM 

-9.260 

-lo.oao 

-10.390 

*000 

.000 

.000 

MINIMUM 

-21.030 

-16. 170 

-20.040 

.000 

.000 

. 000 

CALL GROUPS 

COMBINED 

(CASES EXC 

LUDEID IF SPECIAL 

CODES 

FOR EITHFR 

VARIABLE) 


0 

OMEAN -12*312 

S* DEW* 1*794 


N 

MAXIMUM 

MINIMUM 


144. 

-9*260 

-21*030 



SUM OF SQUARES 

DF 

BETWEEN 

20.6107 

r> 

WITHIN 

439.8006 

t41 

.'dTAL 

460,4912 

143 


MEAN SQUARE F RATIO PROD. F EXCEEDED 
10.3053 3.3033 .0396 

3.1197 
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J TABULATION OF VARIABLE 


4 AHEiOTB 


HUDPl HUD2 HUH3 

. F + F F F 

MIDPOINTS 

17.000) 

16.000) 

IP. 000) 

14.000) 

13.000) 

12 . 000 ) * 

11 . 000 ) 

10 . 000 )* 

9.000) 

8 . 000 ) **** 

7.000) *** 

6 . 000 ) ***** *** ♦ 

5.0()0)M******** ***** 

4.000) ********* ****** ** 

3.-000)********* M****.***21 ****** 

2.000) **** ********14 M***«***20 

1.000) ** ********19 

. 000 ) 

- 1 . 000 ) 

- 2 . 000 ) 

-3 . 000 ) 

GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH *'S^ N'S OTHERWISE 


MEAN 

4 . 962 

3.172 

1.903 

.000 

.000 

.000 

S. DEV. 

2.197 

1.205 

1.060 

.000 

.000 

.000 

N 

45 . 000 

51 .000 

48.000 

.000 

.000 

.000 

MAXIMUM 

12.100 

6 . 220 

6.390 

.000 

.000 

.000 

MINIMUM 

2.090 

1.130 

.750 

. 000 

.000 

. 000 


OALL GROUPS COMBINED (CASES EXCLUDED IF SPECIAL CODES FOR EITHER VARIABLE) 
0 

OMEAN 3.308 

S. DEV. 1.973 

N 144. 

MAXIMUM 12,100 

MINIMUM .750 



SUM OF SQUARES 

DF 

MEAN SQUARE F RATIO 

PROB. F EXCEEDED 

BETWEEN 

218.7544 


109.3772 45.6520 

,0000 

WITHIN 

337.8203 

141 

2 . 3959 


TOTAL 

556.5747 

143 
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1TABULAT.IGN OF VARIABLE 2 FALT 


HUriPl HUD2 HUri3 

+ + 


ilDF-OINTS 

110.000) 

105.000) 



100.000)* 

95.000) 

* 


90 . 000 ) 

X* 


85 . 000 ) * 

* 


80.000)* 

«* 


75.000) 

*** 


70.000)* 

** 


65.000)*# 


* 

60 . 000 ) ** 

»«** 


55.000)##* 

******* 

****** 

50.000)******** 

H*#*** 

********* 

45.000)M******** 

******** 

H*******.13 

40. 000 )#**#**** 13 

♦#**;* 

*♦*:** ***13 

35 . 000 ) *# 

*** 

**** 

30 . 000 ) * #** 

**** 

* 

25 . 000 ) 

*# 

* 

20 . 000 ) * 

15.000) 

10.000) 

* 



GROUP HE AMS ARE DENOTED 

BY M'S 

IF THEY COINCIDE 

WITH 

*'Sf N'S OTHERWISE 

MEAN 

47.453 


44.875 

.000 

.000 .000 

S. DEV, 

14.637 

10.180 

7.034 

.000 

.000 .000 

N 

48.000 

51 .000 

48.000 

♦ 000 

.000 .000 

MAXIMUM 

100*000 100*000 

63.000 

.000 

,000 ,000 

MINIMUM 

19.000 

22.000 

25.000 

.000 

.000 .000 

CALL URGLIPB COMBINED < CA 

yv 

SES EXCLUDED IF SF-ECIAL 

CODES 

FOR EITHER VARIABLE) 

V 

OMEAN 

43.279 





S. DEV. 

14.410 





N 

147. 





MAXIMUM 

100.000 





MINIMUM 

19.000 






SUM OF SQUARES 

DF 

MEAN SQUARE F 

RATIO 

PROB. F EXCEEDED 

BETWEEN 

1394.7100 

2 

697.3550 3 

.4722 

.0337 

WITHIN 

23920.7461 

1-14 

200.8385 



TOTAL 

30315.4531 

146 
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IIABULATION OF VARIABLE 


4 FYCG 


HUBPl HUD2 HUD3 

+ f «■ + + 


MIDPOINTS 

120.000) 

110.000) 

100 . 000 ) 

90.000) 

80.000) 

70.000) 

60 . 000 ) * 

50.000)* 

40.000) 

30.000) ** 

20 » 000 )****** 

10 . 000 ) ******** 

. 000 ) M ******* 1 1 

- 10 . 000 )*** 


* 


* * 

** 

* 

* * 

********** * 

********* ******** 
M********* M******+28 
********* ****** 


- 20 . 000 )******** 11 *** 
-30.000)* ** 

-40.000>** ** 

-50.000)** * 

-60.000) 

-70,000) 

—80 . 000 ' 

GROUP Ml. «MS ARE DENOTED BY M'S 


* 

* 


IF THEY COINCIDE WITH *'S» N'S OTHERWISE 


MEAN 

-2.250 

3.078 

4.062 

.000 

.000 

.000 

S. DEV. 

22.672 

22.136 

17.964 

. 000 

.000 

.000 

N 

48.000 

51.000 

48.000 

.000 

.000 

.000 

MAXIMUM 

57.000 

59.000 

90.000 

.000 

.000 

.000 

MINIMUM 

-50.000 

** 4 

-33 . 000 

.000 

.000 

.000 

CALL GROUPS 

COMBINED 

< CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


0 


OMEAN 
S. DEV. 
N 

MAXIMUM 

MINIMUM 


1 . 660 
21 ,090 
147. 
90.000 
-50 . 000 



SUM OF SQUARES 

DF 

MEAN SQUARE F RATIO 

PROD. F EXCEEDED 

BETWEEN 

1113.4878 

2 

556.7439 1.2561 

.2879 

WITHIN 

6382U. 1992 

144 

443.2305 


TOTAL 

64938.6836 

146 
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ITABULATION OF VARIABLE 


2 FVQVR 


1UDP1 

HUD2 

HUD3 

MIDPOINTS 

22.500) 
21.000) 

19.500) 

..+ 

+ 

18.000)# 

16.500) 

15.000) 

13.500) 

12.000) 

* 


10.500)* 



9.000)** 

t 

** 

7.500)** 

tt 

«* 

6.. 000)****** 


**** 

4.500)******* 


****** 

3.000)M******* 


****** 

1 .500)****v** 


M*******.12 

.000)******** 

♦ **:*:**5K:iai 

***.******* 

-1.500)***** 


***** 

-3.000)* 
-4.500) 
-A . 000 ) 
-7.500) 


* 


GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE UITH *'Sr N'S OTHERWISE 


MEAN 

3.310 3.322 

2.202 

.000 

.000 

.000 

S. DEV. 

3.a^^3 3.902 

2.916 

.000 

.000 

.000 

N 

48.000 51 .000 

48.000 

. 000 

.000 

.000 

.KIMUM 

18.200 17.800 

8.500 

.000 

.000 

.000 

.1 IN I MUM 

-2.900 -3.700 

-2 . 900 

.000 

.000 

.000 

OALL GR0UF:-S combined (CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 

V 

OMEAN 

2.952 





S. DEV. 

3 . 603 





N 

147. 





MAXIMUM 

18.200 





MINIMUM 

-3.700 






SUM OF SQUARES DF 

MEAN SQUARE F 

RATIO 

PROB. F EXCEEDED 

BETWEEN 

40.1256 2 

20.0628 1 

.5573 

.214 

n 

tSm 

WITHIN 

1055.1482 144 

12.8830 




TOTAL 

1895.2737 146 
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iTABULATION OF VARIABLE 3 FHDOT 


HUDPl HUD2 HUD3 

. + + + + + 

MIDPOINTS 

- 2 . 000 ) 

-3.000) 

-4.000) 

-5.000) 

- 6 . 000 ) 


-7.000)* 

*« 

* 

-8.000)*** 

* 

*** 

-9.000)*** 

»*««***» 

******** 

-10.000)**** 

«*»«*** 

******** 

-1 1 .000 )*****♦» 

******** 

M*******H 

-12.000)******** 

M******** 

**** 

-13.000)M***** 

***** 

******** 

-14,000)**** 

***** 

*« 

-15,000)*** 

** 

*** 

-16. 000 ) *** 
-17.000)#*** 

** 


-13.000)* 

-19.000)* 

-20.000) 

-21.000) 

-22.000) 

«* 



GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH *'S. N'S OTHERWISE 


MEAN 

-12.602 

-11.627 

-11.002 

.000 

.000 

.000 

S. DEV. 

2.857 

2.518 

1.888 

.000 

.000 

.000 

N 

48.000 

51.000 

48.000 

.000 

.000 

.000 

MAXIMUM 

-6.900 

-6.800 

-7.300 

.000 

.000 

.000 

MINIMUM 

-19.000 

-18.200 

-15.400 

.000 

,000 

.000 

CALL GROUPS COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


0 

OMEAN 
S. DEV, 
N 

MAXIMUM 

MINIMUM 


-11.741 

2.523 

147. 

-6.800 

-19.000 



SUM OF SQUARES 

DF 

MEAN SQUARE F RATIO 

PROB. F EXCEEDED 

BETWEEN 

62.4557 


31.2278 5.1783 

.0067 

WITHIN 

868.3162 

144 

6.0300 


TOTAL 

930.7717 

146 
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ITABULATION OF VARIABLE 


A LXCG 


HUDPl 

HUD2 

HUD3 

MIDPOINTS 

3450.000) 


. + 

3300.000) 

3150.000) * 



3000.000) 

* 


2850.000)* 



2700.000)** 



2550.000)* 


* 

2400.000)* 

*** 

** 

2250*000) 


**« 

2100*000)* 


******* 

1950*000)**** 


**** 

1800*000)**** 

** 

M******* 

1650*000)**** 

m 

***** 

1500*000)M** 

******** 

********** 

1350*000)****** 

**** 

***** 

1200*000)***** 

*** 

* 

1050.000)****** 

***** 


900.000)** 


** 

750.000)***** 

**** 


600.000)* 

** 



450.000)* 

GROUF> MEANS ARE DENOTED BY M'S IF THEY COINCIDE UITH *'S» N'S OTHERWISE 


MEAN 

1491.653 

1719.968 

1751.216 

.000 

.000 

.000 

S. DEO. 

626.243 

692.466 

371.652 

.000 

.000 

.000 

N 

48.000 

51 .000 

48.000 

.000 

.000 

.000 

MAXIMUM 

3120.000 

3252.500 

2570.000 

.000 

.000 

.000 

MINIMUM 

510.000 

531.000 

864.000 

.000 

.000 

.000 

OALL GROUPS 

COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES FOR 

EITHER 

VARIABLE) 


0 


OMEAN 
S, DEV. 
N 

MAXIMUM 

MINIMUM 


1655.619 

590.102 

147. 

3252.500 

510.000 


SUM OF SQUARES 
BETUEEN194031S.OOOO 
WITHIN 8899872.0000 
TOTAL 0840176.0000 


DF 

144 

146 


MEAN SQUARE F RATIO 
970157.5000 2.8569 
339582.4375 


PROD. F EXCEEDED 
.0607 


53 



ITABIJLATION OF VARIABLE 


2 LYCG 


HUDPl HUD2 HUD3 

+ {■ 4- + + 

MIDPOINTS 

77.000) 

70.000) 

63.000) 

56.000) 

49.000) * 

42.000) * 

35.000) * * **** 

28.000) ** * 

21.000)** **** ** 

14.000)**** ****** ******* 

7.000)********!) ********11 M******** 

.000)M*******12 M******** **.**.****15 

-7.000)******* ********* ***** 

-14.000)***** *** ***** 

-21 ; 000 )*.*** **** 

-28.000)* 

-35.000) 

-42.000) 

-49.000) * 

-56. 0<- ) 


-63 . 000) 

(3R0UP MCANE ARE DENOTED BY M'S IF THEY COINCIDE WITH *'Sf N'S OTHERWISE 


MEAN 

.969 

2.S92 

5 * 635 

.000 

. 000 

. 000 

S. DEV* 

14.084 

15*970 

12*639 

.000 

.000 

.000 

N 

48.000 

51*000 

43*000 

.000 

.000 

.000 

MAXIMUM 

50.500 

44*000 

35*300 

.000 

.000 

.000 

.MINIMUM 

-25.500 

-48*000 

-14.000 

.000 

.000 

.000 

ALh. GROUPS 

COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


OMEAN 3.160 

S. DEV. 14.361 

W 147. 


MAXIMUM 50.500 

MINIMUM -48,000 


SUM U- SQUARES Dr 
BETWEEN 528.2605 2 
WITHIN 29532.4063 144 
TOTAL 30110.6641 146 


MEAN bQUARE F RATIO PROB. F EXCEEDED 
264.1301 1.2857 .2796 

205.4334 


54 



ITABULATION OF VARIABLE 


3 LMAXVEO 


HUDPl HUD2 HUBS 

.-f + + + 

MIDPOINTS 

156.000) 

154.000) * 

152.000) 

150.000) 

148.000) 

146.000) » 


1AA.000)% 



lA2.000y*t 



140*000)** 

* 


133.000)** 

tin*.* 

* 

136.000)***** 



134.000)******** 


-;|c«4c«« 

132 . 000 )M******** 

M*****»*12 


130.000)****** 

»**'4:****11 


123% 000 )***>.** 


**** 

126.000)*** 

t* 

*:♦>**•♦*** 

124.000)*** 

t*. 

***** 

i. 22. 000) 

*. 

* 

120.000) 


* 


llfl.OOO) 

116.000) 

GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH ♦'Sf N'S 


OTHEF;WISE 


MEAN 

132.644 

132.560 

130.458 

.000 

.000 

.000 

S. DEV. 

5 . 060 

4.507 

5.746 

.000 

.000 

f 000 

N 

48.000 

51 .000 

48.000 

.000 

. 000 

.000 

MAXIMUM 

145.530 

144.220 

153.160 

.000 

.000 

. 000 

MINIMUM 

123.510 

122.310 

120,500 

.000 

,000 

.000 

OALL GROUPS COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


OMEAN 131.901 

S. DEV. 5.181 

N 147. 

MAXIMUM 153.160 

MINIMUM 120.500 

SUM OF SQUARES 
BETWEEN 148,6094 

WITHIN 3770.8674 

TOTAL 3919.5566 


DF MEAN SQUAf^E F RATIO PROB. F EXCEEDED 
2 74.3447 2.8390 .0618 

144 26.1866 

146 
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ITABULATION OF VARIABLE 


A LMAXHDOT 


HUDPl 


MIDPOINTS 

5.000) 

4.000) 

3.000) 

2 . 000 ) 

1 . 000 ) 


HUD2 

+ » » ♦ . 


HUD3 

+ 


+ 


+ 


. 000 ) 

- 1 . 000 )*** **** 

- 2 . 000 ) ********11 *#*****#14 
-3 . 000 ) M*******l 4 M*******l 1 
- 4 . 000 )******** 11 ********12 


-5.000)**** 

- 6 . 000 )** 

-7.000) 

-3.000)* 

-9.000)* 

- 10 . 000 )* 

-11.000) 

- 12 . 000 ) 

- 13 . 000 ) 

-14. OOO ) 
-15.000) 

GROUP MEANS ARE 


********* 

» 


DENOTED BY M^S 


««* 

****.#***13 

M******#1Q 

********11 

**.f; 


IF THEY COINCIDE WITH 


*' 5 j 


N'S OTHERWISE 


MEAN 
S. DEV. 

N 

MAXIMUM 
MINIMUM 
OALL GROUPS 


-3,492 

-3.225 

-2.919 

.000 

.000 

1.822 

1 .277 

1,044 

.000 

.000 

48.000 

51.000 

48 . 000 

.000 

.000 

-1.100 

-1,100 

-.600 

, 000 

.000 

-9.900 

-6.300 

-5.300 

.000 

.000 


COMBINED (CASES EXCLUDED IF SPECIAL CODES FOR EITHER 


.000 
. 000 
.000 
. 000 
.000 
VARIABLE) 


OMEAN 
S. DEV. 
N 

MAXIMUM 

MINIMUM 


-3.212 
1 . 426 
147. 

- . 600 
-9,900 


BETWEEN 

WITHIN 

TOTAL 


i OF SQUARES 

DF 

Mt.AN SQUARE 

7.8913 

2 

3.9457 

288.9255 

144 

2.0064 

296.8167 

146 



F RATIO 
1.9665 


PROB. F EXCEEDED 
. 1437 
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1 TABULATION OF VARIABLE 


2 OMALT 


HUDNl HUD2 HUD3 

F. + + + -I- 


MIHPOINTS 

20 ^ 0 . 000 '* 

2000. OOC/)* 

1960.000) 

1920.000) * * 

1880.000) 

1840.000) ♦ 

1800.000) * 

1760.000) * * 

1720.000) 

1680.000) * 

1640.000) * ** * 

1600.000) * ** * 

1S60 . 000 > ********* ********11 **** 

1520.'000)M*******17 M**»****15 M*******18 

1430 .000) **#*****19 ********14 ********27 

1440 . 000 ) *■*♦** ******** **** 

1400.000) * *** ** 


1360.000) ** ** 

1320.000) 

12B0.000) 

1110.000) * 

1200 . 000 ) 

r.kOUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH *'Sf N'S OTHERWISE 


MEAN 

1531.573 1508.597 

1515.697 

*000 

.000 

*000 

S. DEV. 

121.043 83.651 

81.542 

*000 

.000 

.000 

N 

59.000 60.000 

60.000 

*000 

.000 

.000 

MAXIMUM 

2026.000 1843.000 

1914 , 000 

*000 

. 000 

.000 

MINIMUM 

1362.000 1234.000 

1404.000 

*000 

.000 

*000 

OALL GROUP 

A 

S COMBINED (CASES EXCLUDED IF SPECIAL 

CODES FOR 

EITHER 

VARIABLE) 

OMEAN 

1518.549 





5. DEV* 

96.900 





N 

179. 





MAXIMUM 

2026.000 





MINIMUM 

1234,000 






SUM OF SQUARES 
BETWEEN 16439.6211 
WITHIN 1654929.0000 
TOTAL 1671368.0000 


DF MEAN SQUARE F RATIO PROS. F EXCEEDED 
2 8219.8086 .8742 .4190 

176 9403.0039 

178 
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IThBULhTION of variable 


3 OMYCG 


HUDNl HUD2 HUD3 

+ + + + 

MIDPOINTS 

1500.000) 

1 >500.000) 

1300.000) * 

1200.000) 

1100.000) 

1000.000) 

900.000) * 

800.000) » 

700.000) 

*•■>0.000) *•* 

500 . 000 ) * * 

>500.000) ** 

300.000) ** *** 

20C> . 000 ) **** ******* ***** 

100.000) ********** ********13 M****’***12 
.000)M*******20 M*****«*24 ********16 

“100.000)********** ********13 ******** 

- 200 . 000 )***** ** ******* 

-300.000)*** * * 

->5'r"0,ooo)* * 

-500 . 000 ) * 

-<*>.,)o . 0*: 0 > * 

(iRGUP MEANS ARE DENOTED BY M"S IF THEY COINCIDE WITH *'St H'S OTHERWISE 


MEAN 

-13,119 

15.133 

77.600 

.000 

.000 

.000 

S. DEV. 

220.394 

101.572 

279.049 

,000 

.000 

.000 

N 

59.000 

60 . 000 

60.000 

,000 

.000 

.000 

MAXIMUM 

836 . 000 

239 . 000 

1345.000 

.000 

.000 

.000 

MINIMUM 

■" 6 1 4 # 0 () 0 

-256.000 

-436.000 

.000 

.000 

,000 

CALL GFvOUPS 

1 COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIADLE) 


0 


OMEAN 26.760 

S. DEV. 215.308 

N 1-79 . 

MAXIMUM 13>5S.OOO 

MINIMUM -614,000 

SUM OF SQUAF^ES 
BETWEEN 257020.0000 
UITHIN 3033009.0000 
TOTAL 3290029.0000 


MEAN SQUARE 
12.8510.0000 
>55642.0938 


F RATIO PROB. F EXCEEDED 
2.8156 .0626 
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1 TABULATION- OF VARIABLE 


4 OMVQVR 


HUDNl HU02 HUD3 

.-f + -f + 


MIDPOINTS 

26 , 000 ) 

22 , 000 ) 

20 , 000 ) 

27.000) * * 

24.000) 

21 . 000 ) *** ** * 

JQ.OOO)* ** * 

15.000)**** *** 

12 . . 000 )*** * *** 

9 . 000 ) ********11 ******** **** 

6.000) M*******13 ********12 ********12 

3.000) ********* M*******12 M*******19 

. 000)********11 ********** ********11 

-3.000)** ***** ***** 

- 6 '. 000 ) * *** * 

-9.000) * ** 


- 12 . 000 ) 

-15.000) 

-IS. 000) 

- 21 . 000 ) * 

-24.000) 

-27.000) 

GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH *'Sf 


+ 


N'S OTHERWISE 


MEAN 

6.703 

4.297 

3.000 

.000 

.000 

.000 

S. DEV. 

6.531 

7.015 

6.253 

.000 

.000 

.000 

N 

59.000 

60 . 000 

60.000 

.000 

.000 

.000 

MAXIMUM 

20.400 

20.500 

27,900 

.000 

.000 

.000 

MINIMUM 

-5.400 

19,600 

-9,600 

.000 

.000 

.000 

ALL GROUPS COMBINED < CA 

SES EXCLUDED IF SPECIAL 

CODES FOR 

EITHER 

VARIABLE) 

MEAN 

4.950 






S* DEV* 

6.607 






N 

179. 






MAXIMUM 

20.400 






MINIMUM 

-19.600 







SUM OF SQUARES DF 

MEAN SQUARE 

F RATIO 

PROB. F 

EXCEEDED 

BETWEEN 

275.6931 

n 

137.0466 

3. 1570 

.0450 

WITHIN 

7604.7539 

176 

43.6634 




TOTAL 

7960 . 4453 

170 
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1 TABULATION OF VARIABLE 


2 I ALT 


HUDNl HUD2 HUD3 

+ f + + 


MIDPOINTS' 

2310.000) * 

2240. OOC. 

2170.000) 

2100 . 000 ) * 

2030.000) * 

1960.000) * ** 

1890.000) 

1820.000) *** * 

1750.000) * * *** 

1680.000) ** * * 

1610.000)****** ***** *** 

1540.000) M*******18 M*****:K*17 M*.******16 
1470 . 0<>0)********17 ********14 ********26 

1400.000) ** ****** * 


1330.000) 

1260.000) 

1190.000) 

1120.000) 

1050.000) 

930.000) * 

0 . 000 ) 

CtROUP means are denoted by M'S if they coincide with *'S» n^s otherwise 


MCTriN 

1566.262 

1520.435 

1553.719 

.000 

.000 

,000 

S. DEV, 

159.623 

129.093 

136.815 

.000 

. 000 

.000 

N 

49.000 

48.000 

54.000 

.000 

,000 

,000 

MAXIMUM 

2277 . 000 

1845.000 

2034.000 

. 000 

.000 

.000 

MI MI MUM 

1414. 000 

1010.000 

1369.000 

,000 

.000 

. 000 

)hll group* 

S COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 




^MEAN 
S. DEV. 
N 

MAXIMUM 

MINIMUM 


1547.208 
142.661 
151 . 

2277.000 

1010.000 



SUM OF SQUARES 

DF 

MEAN SQUARE F RATIO 

PROB. F EXCEEDED 

BETWEEN 

54486,3203 


27243.1602 1.3447 

.2638 

WITHIN 

2998348.0000 

149 

20259.1055 


TOTAL 

3052834.0000 

150 
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TABULATION OF VARIABLE 


3 ivnvR 


HUDNl HUD2 HUD3 

+ I-. . ; + + 


MIDPOINTS 

'12,000) 

39.000) 

36.000) 

33.000) 

30.000) * 

27.000) ** * 

24.000) * ** 

21 . 000 ) * *** 

18.000)*** ** 

15.000) ***** **«* 

12 . 000 ) *** ******* ***** 

9.000)M*** *«* ***** 


6 . 000 ) ********13 M*.******14 M******* 


3.000)********** ********* 

. 000 )****** ***** 

-3,000)** ***** 


********* 

********* 

***** 


- 6 . 000 ) * 

-9.000) »* * 

- 12 . 000 ) 


-15.000) 

-IS. 000) 

GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH *'Sf N'S OTHERUISE 


MEAN 

7.900 

4,760 

7 

S, DEV. 

7.348 

6 , 799 

8 

N 

49.000 

48,000 

54 

MAXIMUM 

27,300 

26,900 

30 

MINIMUM 

-2.300 

-9,900 

-7 

OALL GROUPS 

COMBINED (CA 

SES EX 

CLUDED 

0 




OMEAN 

6.689 



S. DEV. 

7.617 



N 

151 , 



MAXIMUM 

30.600 




,304 

.000 

,000 

.000 

.317 

.000 

.000 

,000 

.000 

.000 

.000 

.000 

.600 

,000 

,000 

,000 

.500 

,000 

.000 

.000 

IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


MINIMUM 


-9.900 



SUM OF SQUARES 

DF 

MEAN SQUARE F RATIO 

PROB. F EXCEEDED 

BETWEEN 

270,7964 

2 

135,3982 2.3768 

.•0964 

WITHIN 

8430.9336 

148 

56,9658 


TOTAL 

8701 .7266 

150 
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1 TABULATION OF VARIABLE 


4 ALOC 


HUDNl HUD2 

MIDPOINTS 

.950) 

, 900 > 

.850) 

.800)4c 

.750) 

.700) 

.650) 

.600) 

.550) 

.500) 


HUD 3 

+ + 




+ + 


.450)* 

, 400 ) 

.350)** 

.300)** * 

. 250 ) ** * * 

. 200 )** ** 

. 1‘50)M******** * *** 

. 100)*******»14 ****** ***** 


.050) ********13 M*******27 M*******25 
.000)*** ********13 ********16 

- . 050 ) 

GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH *'Sf N'S OTHERUISE 


MEAN 

,140 

.052 .071 

.000 

.000 

.000 

S. DEV* 

.137 

.044 .085 

.000 

.000 

. 000 

N 

49.000 48 

.000 54.000 

.000 

.000 

.000 

MAXIMUM 

.310 

.270 .490 

.000 

.000 

.000 

MINIMUM 

.010 

.010 .010 

. 000 

.000 

.000 

•ALL GROUPS COMBINED <CASE 

S EXCLUDED IF SPECIAL 

CODES FOR 

EITHER 

VARIABLE) 

f 

)MEAN 

,037 





S. DEV. 

.103 





N 

151 . 





MAXIMUM 

.810 





MINI MUM 

.010 






SUM OF SQUARES 

DF MEAN SQUARE 

F RATIO 

PROB. F 

EXCEEDED 

BETWEEN 

.2087 

2 .1043 

11.2751 

.0000 

WITHIN 

1.3695 

148 .0093 




TOTAL 

1.5782 

150 
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irARULATlON OF VARIABLE 2 AGS 


HUDNl HUD2 



MIDPOINTS 

1 . 400 ) 

1.330) 

1 , 260 )* 

1 . 190)* 

1 . 120 ) 


1 .OSO) 




,910) 

1C* 

• 3*10) 

1:lclc 

.770) 


.700)11* 

ICiCicir. 

, 630 ) t.* 


,G60)***1c 

IcicicicH; 





*350>***:^.4^** 



tt 




1: 

• 070)* 


- . 000 ) 



ARrUiP MEANS ARE DENOTED BY M' 


HUD3 

+ + + 


* 


#*** 

♦* 

***** 

********* 

*:******** 

N 

*«*««* 

* 

********** 

***** 

** 


IF THEY COINCIDE WITH t'S? 


+ 


N'S OTHERWISE 


MEAN 

.427 


.476 

♦ 574 

.000 

,000 .000 

S. DEV. 

.266 


.253 

.219 

. 000 

.000 .000 

N 

49.000 


48,000 

54.000 

.000 

.000 .000 

MAX I MUM 

1 .240 


1 , 050 

1 . 150 

.000 

.000 ,000 

MINIMUM 

. 100 


.090 

.200 

. 000 

.000 .000 

CALL GROUPS C 

0MB I NED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER VAFv ] ABLE ) 

OMEAN 


495 





S. DEV. 


252 





N 

151 . 






MAXIMUM 

1 . 

240 





MINIMUM 


090 





SUM 

OF SQUARES 

DF 

me;: AN SQUARE 1 

F' RATIO 

PROB. F EXCEEDED 

BETWEEN 

. 5 7 A 4 

n 

.2082 

4.7681 

.0098 

WITHIN 

8. <7455 

IAS 

. 0604 



TOTAL 

<•‘.5219 

150 
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1 TABULATION OF VARIABLE 


3 AEASH 


HUIiNl HUD2 HUD3 

-f f . f 

MIDPOINTS 


154.500) 
153,000)** 

151.500) * 

** 


150.000)* 


** 

148.500) 

147,000) 


*** 

145.500)*** 


* 

144 .000)*** 

* 

* 

1 42 . 500 ) ******* 

*** 

*** 

14 J .000)**** 

******** 

** 

139 . 500 ) M******** 

****** 

******* 

138.000)*** 

M*#*** 

M******** 

136 .‘500) **** 

********* 

*******.♦15 

J 35.000)*** 

********11 

******** 

133.500)**#** 

** 

* 

132.000)# 


** 

1 30 , 500 > ** 

129.000) 

127.500) 

126.000) * 

124.500) 




GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH *'8 


+ 


N'S OTHERWISE 


MEAN 

139.715 

138.537 

138.592 

.000 

.000 

.000 

S. DEV. 

5.726 

3 . 883 

4,128 

.000 

.000 

.000 

N 

49.000 

48.000 

54.000 

.000 

.000 

.000 

MAXIMUM 

153.650 

152.130 

150.400 

. 000 

,000 

.000 

MINIMUM 

126.100 

132.950 

131.930 

,000 

.000 

. 000 

CALL GROUPS COMBINED 

< CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


C* 


OMEAN 
S, DEV, 
N 

MAXIMUM 

MINIMUM 


138.939 
A,6A0 
151 . 
153. A50 
126.100 


SUM OF SQUARES 
BETWEEN 43.8198 

WITHIN 3185.5002 

TOTAL 3229.3188 


Df* 

2 

14S 

150 


MEAN SQUARE F RATIO 
21.9094 1.0179 

21.5236 


PROD. F EXCEEDED 
.3639 
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ITArslJLATION OF VARIABLE 


A AEASB 


HLJDNl 

HUD2 

HUD3 

Midpoints 
15. 000) 

14.000) 

13.000) 

12.000) 
11.000) 
) 0.000) 



9.000) 
B.OOO) 

7.000) * 

* 

* 

A.OOO)** 

* 

* 

5.000)****** 

* 

* 

4 . 000 ) ****** 

***** 

****** 

3.000)M*** 

M****»**17 

M*******21 


+ 


+ 


2. 000 )****.'»::*.«* 17 *******>|;23 ********22 

1 . 000 ) ■*;*»** 1 2 ** 

. 000 )* 

- 1 . 000 ) 

-2 . 000 > 

—3 . 000 ) 

— A • 000 ) 

• ? . 000 > 


GROUr* rXANS 

are: denoted 

DY H'P 

IF THEY COINCIDE 

WITH 

*'S» N'S OTMERWISF. 

hf-AfJ 

2.709 

2.853 

2.849 

.000 

.000 .000 

S* DEV. 

1.640 

1.248 

1.214 

.000 

.000 .000 

N 

49,000 4 

8.000 

54.000 

.000 

,000 .000 

MAXIMUM 

7,120 

8.780 

8.950 

.000 

.000 .000 

MINIMUM 

.500 

1 . 580 

1.210 

.000 

.000 .000 

OALL GROUPS 
a 

CGMtilNEiiD (CAS 

e:s excluded if special 

CODES 

FOR EITHER VaPIADLE) 

OMEAN 

2.805 





S. DEV. 

1,369 





N 

151 . 





MAXIMUM 

9 . 950 





MINIMUM 

.500 





SUM 

OF B0UARE3 

DF 

MEAN SQUARE F* 

F<ATIO 

PROD. F EXCEEDED 

DETWEEN 

.6689 


.3344 

. 1765 

.8383 

WITHIN 

280.3723 

148 

1.8944 



TOTAL 

281 .0410 

150 
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n ADULATION OF VARIADLE 


2 AHDOTMAX 


HUDNl 


HUD2 


HUD3 


MIDPOINTS 
-15,000) 

-16.500) 

-18.000)**** 
-19,500)****** 

- 21 , 000 )******** 
-22.500)****** 
-2‘),000)M******* 
-25.500)*** 

-27,000)***** 

-23. 500) 

- 20 . 000 )* 

-31.500)* 

-33.000)* 

-3^). 500)** 

-? 4 . . 000 ) * 

-37.500) 

- 39 . 000 ) * 

-AO, 500)** 

-A 2. 000) 

-A3. 500) *# 

-AS. 000) 

GROUP KEANS AFi;E DENOTED BY 


** 

*« 

***** 

******** 

****** 

M******** 

*** 

***** 

** 

*** 

* 


***» 

********12 

***♦*.***15 

H****** 

******* 

**** 

«* 

** 

* 


M'S IF THEY COINCIDE WITH *'S» N'S OTHERWISE 


me:an 

-2A.702 

24.214 

-23.504 .000 

,000 .000 

s* Dev. 

5.899 

5.453 

2.753 .000 

.000 .000 

N 

A9.000 

43.000 

54.000 .000 

,000 .000 

NAXlrtUii 

-17.610 - 

16.470 

-19.020 .000 

. 000 . 000 

H INI MUM 

-AO. 760 

43.970 

-31,520 .000 

.000 .000 

OALL GROUPS COMBINED (CA 

SES EXCLUDED IF SPECIAL CODES 

FOR EITHER UARIABl.E) 

V 

OMEAN 

-24.113 




S. DEO. 

4.335 




N 

151 . 




MA.XIMt.IM 

-16.470 




MINIMUM 

-43.970 





SUM OF 30UARES 

DF 

MEAN SOUARE F RATIO 

PROB. F EXCEEDED 

BETWEEN 

37.5551 

2 

13.7776 .8010 

.4508 

WITHIN 

3469.6973 

148 

23.4A39 


TOTAL 

3507.2527 

150 
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3TAHULATI0N OF VARIABLE 


3 AHDOTM 


HUDNl 


HIDROINTS 
- 5 . 000 ) 
- 6 . 000 ) 
-7.000) 
-3.000) 


HUD2 

^ . 


HUD3 

♦ 


+ 


-9.000) 

- 10 . 000 ) 

- 11 . 000 ) 

- 12 . 000 )*** 

-13.000)***** 

-14.000)*** 

-15.000)M******)H3 
-16 . 000 ) ***.#****11 
-17 . 000 ) ********** 

-JB.OOO)** 

-19,000)* 

- 20 , 000 )* 

- 21 . 000 ) 

-22 . 000 ) 

-23.000) 

-24.000) 

-2lv . OOO ) 

GROUP MFANS ARE DFiNOTELi BY H ' S 


« 


»* 

***** 

******** 

H****** 

********12 

**** 

******** 

* 


« 


***** 

******* 

********* 

H *******12 

%%%%%% 

%^%%% 

% 


TF- THFY COINCIDE 


+ 


WITH 


+ 


W'S OTHERWISE 


HEAi-^ 

-15*474 -15.324 

-17.038 

.000 

,000 .000 

S . IiEV 

1.751 2.007 

2 . 250 

.000 

.000 .000 

N 

49 . 000 43 . 000 

54 , 000 

* 000 

.000 .000 

HA /(T HUH 

-11 .360 -8.950 

- 11 ,120 

.000 

.000 .000 

hih.i:huh 

-19.720 -18.790 

-22.200 

.000 

.000 .000 

OAI..L GROUPS 

COMBINED (CASES EXCLUDED IF SPECIAL CODES 

FOR EITHER VARIABLE) 

oheah 

-15.986 




S. DEV. 

2.158 




N 

151 . 




MAXIMUM 

-3.950 




MINIMUM 

-22.200 




SUM 

OF SQUARES DF 

MEAN SQUARE 

F RATIO 

PROB. F EXCEEDED 

BETWEEN 

93.5330 2 

46.7940 

11.4516 

.0000 

UITHIiN 

604.7637 140 

4 . 0862 



TOTAL 

698.3516 150 
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1 TABULATION OF VARIABLE 


•1 AHLiOTI.1 


HUDNl 

HUD2 

+ 

HUD3 

+ 

MIDPOINTS 

19 . 000 ) 

18 . 000 ) 

1 7 . 000 ) 

16 . 000 ) 



15 . 000 ) 

14 . 000 ) 

13 . 000 ) * 

12 . 000 ) 
11 . 000 ) 

** 


10 . 000 )** 


*** 

9 , 000 )** 

«* 

* 

8 . 000 )***** 

*« 

*** 

7 . 000 )* 

***** 

********** 

6 . 000 )** 

**** 

******* 

5 . 000 ) M * r * 

M ***** 

M * ****** 

A . 000) ********14 

********11 

***** 


+ 


+ 


3.000 ***** 

2 . 000 } ******** ********* ******** 

1 . 000 > **** 

. 000 > 

-1 jOOO) 

GROUP HUANG ARE DENOTED E<Y M'S IE THEY COINCIDE WITH *'Sf N'S OTHERWISE 


MEAN 

4.770 5,027 

5.000 

.000 

. 000 

. 000 

S. DEV. 

2.635 2.835 

2.419 

.000 

.000 

.000 

N 

49.000 48,000 

54.000 

.000 

.000 

. 000 

MAXIMUM 

13.460 15,850 

:l 0 . 240 

. 000 

.000 

. 000 

MINIMUM 

1.970 1.550 

1.160 

.000 

.000 

» 

OALL GROUPS COMBINED (CASES EXCLUDED IF" SPECIAL 

CODES 

F-OR EITHER 

OAF<IABLE> 

OMEAN 

4.934 





3. DEV. 

2,612 





N 

151 . 





MAXIMUM 

15.850 





MINIMUM 

1 , 160 






SUM or- SQUARES DE 

MEAN SQUARE F 

RATIO 

PROD, f- 

excee:de:i:i 

BETWEEN 

1,9712 2 

.9856 

.1428 

.8670 

WITHIN 

1021.1792 148 

6.8999 




TOTAL 

1023.1204 150 
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2 FALT 


ITABUl.ATiuN OF VARIABLE 


HUD IN HUD2 HUD3 

+ + ♦ + + + 

HIDPOINTS 

1*17.6oO) 

140.000) % 

133.000) 

J 26. 000) 

U9.000)# 

112 . 000 ) * 

105.000) ** 

98.000) * ** 

91.000) ** ***** 

84.000) *** *** * 

77.000) **** ** ** 

70.000) ** M;*******13 ** 


.'•3 . 000 )M******** 

****** 

****** 




56.000)******** 

*** 

***** 




49.000)****** 

«* 

M*******.13 




42 . 000 ' ***!:***** 

****** 

********** 




35.000)** 

*** 

***** 




28.000) 


****** 




2 1 . 000 > * 


** 




1 4 . 000 ) 


«« 




7 . 000 ) ♦ 






GROUP MEANS ARE DENOTED BY M'S 

IF THEY COINCIDE 

WITH *'3r 

H'S 

OTHERWISE 

MEAN 60.060 

69.437 

46.222 

• 000 

• 000 

• 000 

S. DEV. 20.747 

21.746 

15.462 

• 000 

* 000 

.000 

N 50 . 000 

48.000 

54.000 

• 000 

• 000 

♦ 000 

MAXIMUM 121.000 

142.000 

83 . 000 

• 000 

• 000 

• 000 

MINIMUM 10.000 

34 . 000 

13.000 

• 000 

• 000 

.000 


OALL GROUPS CGHBIHED (CASES EXCLUDED IF SPECIAL CODES FOR EITHER VARIABLE) 
0 

OHEAN 53.105 

S. DEV. 21.526 

N 152. 

HAXIHUH 142.000 

MINIMUM 10.000 



SUM OF SQUARES 

DF 

MEAN SQUAFvE 

F RATIO 

PRDB. F EXCEEDED 

BETWEEN 

13980.3867 


6990* .191 

18.6030 

.0000 

WITHIN 

55987.7891 

149 

375.7568 



'OTAL 

69968.1250 

ISl 
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1 TABULATION OF VARIABLE A FYCG 


HUD IN HUD2 HUD3 

+ + + + . + 

MIDPOINTS 
63 • 000 ) 

56.000) 

-)9,000) 

42.000) * * 

35 . 000 ) * 

28.000) * **** ** 

21 , 000 )**** **** *** 

14.000)** ******* ***** 

7.000)******** ****** ******** 

.OC‘0)********** M********* M*******14 
-7 ,000)M***** **** ********12 

-14,000)******* *** ******* 

- 21 . 000 )**** *** * 

-28,‘000)* ** * 

-35.000)**** **. 

-42.000)* * 

-49.000) 

-56.000)* 

-65.000) * 

-70 . 000 ) 

-77 , 000 ) 

GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE UITH t'Sf N'S OTHERWISE 


MEAN 

-5,440 .042 

1.407 

.000 

.000 

.000 

S, DEV, 

IS. 815 20.597 

12.630 

. 000 

.000 

,000 

N 

50.000 48.000 

54 , 000 

.000 

.000 

.000 

MAXIMUM 

42.000 38.000 

43.000 

.000 

.000 

.000 

MINIMUM 

-56.000 -63.000 

-25.000 

.000 

.000 

.000 

OmLL groups combined (CASES EXCLUDED IF SPECIAL 

A 

CODES 

FOR EITHER VARIABLE) 

OMEAN 

-1.276 





G. DEV. 

17.653 





N 

152. 





MAXIMUM 

43.000 





MINIMUM 

-63.000 





BETWEEN 

SUM OF SQUARES DF 

MEAN SQUARE F 

RATIO 

PROB. F EXC 

EEDED 

1339,1155 2 

669.5576 2 

. 1011 

.1165 

WITHIN 

45741.0703 149 

306.9868 



TOTAL 

47080.1836 151 
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ITABULATIQN OF VARIABLE 


2 FVaVR 


HUBNl 


MIDPOINTS 

21 . 000 ) 


HUD2 

4* » . . . 


HUD 3 

+ 


+ 


+ 


19.500) 
18.000) 

16.500) 

15.000) 

13.500) 

12 . 000 ) * 

10.500) ** 

9.000) ** 
7.500)****** 

6 . 000 ) *** 


« 


* 

** 

« 

** 

******* 

M*******.13 

******** 

****** 

**** 

♦ 

* 

« 


DENOTED BY M'S 


4.500) ****** 

3. 000) M* ******** 

1 .500) **.****** 

. 000 ) ****** 

-1 .500)* 

-3.000)** 

-4.500K** 

— 6 . 0'/ J ) 

-7.500)* 

- 9 . 000 ) 

GROUP MEANS ARE 


♦ 


**** 

***** 
******* 
M******* 
********** 
********11 
♦ *** 

*** 

* 


IF THEY COINCIDE WITH *'S» N'S 


OTHERWISE 


MEAN 

3.160 

4.252 

2.269 

.000 

.000 .000 

S. DEV. 

A , 155 

3.907 

3.441 

.000 

.000 .000 

N 

50.000 

48.000 

54.000 

.000 

.000 .000 

MAXIMUM 

11.600 

18.700 

13.300 

.000 

.000 .000 

MINIMUM 

-8 . 200 

-4.200 

-4.400 

.000 

,000 .000 

OALL GROUPS COMBINED (CASES EXCLUDED IF SPEC I 

A 

AL CODES 

FOR EITHER VARIABLE) 

OMEAN 

3.191 





S. DEV. 

3.895 





N 

152. 





MAXIMUM 

18.700 





MINIMUM 

. 200 






SUM OF SOUARES 

DF 

MEAN SQUARE 

F RATIO 

PROB. F EXCEEDED 

BETWEEN 

100.0222 

n 

50.0111 

3.4015 

.0359 

WITHIN 

2190.7109 

149 

14.7028 



TOTAL 

2290.7332 

151 
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1 TABULATION OF VARIABLE 


3 FHDOT 


HUDNl HUD2 HUD3 

. . + »• 


hlDPOINTS 
3.000) 

1.500) 

. 000 ) 

-1.500) 

— 3 ♦ 000 ) 

-4.500) 

-A. 000) 

-7.500)*# 

-9.000)# 

-10.500)#*#*#* 

- 12 . 000 )***# 

-13. 500 )#**;♦ **#*#* 
-15 . 000 )«*#***##*# 
-1A.500)*##**** 

- 18.000)*##* 
-19.500)##*# 
- 21 . 000 )* 

-2?. 500)* 


# 

# 

«# 

** 

#**##### 

######*## #*#####*15 

#*## H###*«* 

*#**###*12 ######«## 
H*##****# #*#*# 

#«## 

*####* 

##### 

#*« 


+ 


+ 


-24.000) 

-25.500) 

-27.000) 

fjRQUH- MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH #'Sf N'S OTHERUISE 


MEAN 


-14.424 

14.762 

-11.346 

.000 

. 000 

. 000 

S. DEV. 


3.272 

3.291 

2.907 

.000 

o 

o 

, 000 

N 


50.000 

48 . 000 

54.000 

. 000 

♦ 000 

.000 

MAXIMUM 


-7.300 

-9.800 

-2 . 700 

.000 

. 000 

, 000 

MINIMUM 


-22.100 

21.700 

-16,800 

.000 

*000 

.000 

OALL GROUPS 

A 

COMBINED (CA 

SES EXCLUDED IF SPECIAL CODES 

fof;: either oaf 

< I ABLE) 

OMEAN 


-13.437 






S. DEV. 


3.501 






N 


152. 






MAXIMUM 


-2.700 






MINIMUM 


-22.100 







SUM 

OF SQUARES 

DF 

MEAN SQUARE 

F RATIO 

PROP. F EXCEEDED 

BETWEEN 


369.0784 

2 

184.5392 

18.5654 

. 0000 


WITHIN 

1481.2100 

149 

9.9410 




TOTAL 

1 

850.2883 

151 
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ITABULATION OF VARIABLE 


4 LXCG 


HUDNl HUD2 HUD3 

+ + -f -h + 

MIDFOINTS 

3S00.000> 

3.400.000) 

3400.000) 


3200 . 000 ) ** 

** 


3000.000) 

*» 


2300 . 000 ) ** 

*** 

* 

2600.000)*#* 

**** 

***** 

2400.000 )***#*# 

**** 

*** 

2200.000)**** 

***** 

******* 

2000 . 000 ) ******* 

M**** 

********* 

1S00.000)M****** 

**** 

M*** 

1600 . 000 ) ♦*** 

****** 

******** 

1400.000)*** 


******** 

1200.000)**** 

**** 

****** 

1000.000)** 

**** 

** 

soo . Ooo ) **** 

***** 

* 


400. 000 ) » 

400 . 000 ) 

200 . 000 ) * 


. 000 ) 

- 200 . 000 ) 

GROUP MEANS ARE DENOTED DY M'S IF THEY COINCIDE WITH *'Sf N'S OTHERWISE 


MEAN 

1S15 .387 

1901.403 

1807.034 

*000 

.000 

.000 

S. DEV. 

691.858 

710.085 

487.500 

.000 

.000 

.000 

N 

50.000 

48.000 

54.000 

.000 

.000 

.000 

MAXIMUM 

3292.500 

3144.000 

2727.000 

.000 

.000 

. 0()0 

MINIMUM 

234.500 

731 .500 

707.500 

.000 

.000 

.000 

'ALL GROUPS 

COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIADLE) 


OMEAN 1339.582 

3. DEV. 624.911 

N 152. 

MAXIMUM 3292.500 

MINIMUM 234.500 

SUM OF SQUARES 
FtETUEEN 269924.1875 
WITHIN 9075792.0000 
TOTAL 9345712.0000 


DF MEAN SQUARE F RATIO PROD. F EXCEEDED 
2 134962.0625 .3404 .7120 

149 396481.3125 

151 
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1 tabulation of variable: 


2 LYCG 


HUDNl HUD2 HUD3 


+ + 

MIDPOINTS 
60.000) 

55.000) 

50.000) 

45.000) 

40.000) 

35.000) * 

30.000) 

25 . 000 ) * 

20 . 000 ) *#** 

15.000) ***** 

10 . 000 ) ***#*** 

5.000)M***** 

, 000 )*****#** 

-5 . QOO ) ********** 

-10, 000)**** 

-15.000)** 

- 20 . 000 )* 

-25.000) 

-30.000) 

-35.000) 

~40 . 000 ) * 

GROUP MEANS ARE DECNOTED BY M'S 


+ + 


* 


** 

******* 

*♦**.#***13 

M***#***18 

********)» 

** 


* 

* 


IF THEY COINCIDE WITH *'Sf 


* 

«« 

« 

* 

**** 

***** 

******* 

M*#**.*** 

*** 

********* 

** 

*** 

* 

* 


+ 


N'S OTHERWISE 


MEAN 

3.076 

.319 

1.935 

.000 

.000 

.000 

S. DEV. 

12.916 

15.083 

10.708 

.000 

.000 

.000 

N 

50.000 

48.000 

54.000 

.000 

.000 

. 000 

MAXIMUM 

33.000 

40 . 000 

53,000 

.000 

.000 

,000 

MINIMUM 

-42.000 

-35.000 

-32,000 

.000 

.000 

.000 

CALL GROUPS 

COMBINED 

<CASES EXCLUDED IF SPECIAL 

CODES) 

FOR EITHER 

VARIABLE) 


0 


OHEAN 
S. DEO. 
N 

MAXIMUM 

MINIMUM 


1.958 

12.885 

152. 

53 . 000 
-42.000 



SUM OF SQUARES 

DF 

MEAN SQUARE F RATIO 

PROB. F EXCEEDED 

BETWEEN 

124.8229 

n 

Am 

62.4114 .372£? 

.6894 

WITHIN 

24942.8984 

149 

167.4020 


TOTAL 

•'5067.7188 

151 




74 



1 TABULATION OF VARIABLE 


3 LMAyVEQ 


HUDNl HUD2 

MIDPOINTS 

154.000) 

152.000) 

150.000) 

148.000) 

14A.OOO) 

144.000) 


HUD3 

"P . . . . 


* 


+ 


142.000) * 

140.000) *** 

138.000) ***** 

136 .000 ) ****** 

134.000) ****** 

132.000) M***** 

130 .000 ) ***♦*♦** 15 

128.000) ** 

126 .-000)** 

124.000) ** 

1 22 . 000 ) * 

120 . 000 ) 

113.00 


♦ * 

**** 

****** 

******* 

M********* 

******** 

**** 

**♦ 

« 

* 

*« 


** 

** 

**** 

**** 

******* 

M********* 

******** 

******* 

******* 

* 


•.+ 


+ 


116 . 000 ) * 

134. OOO ) 

GROUP ME:hNS are denoted by M'S IF THEY COINCIDE WITH *'Sp N'S OTHERWISE 


MEhN 

132.119 

133*69? 

130.470 

.000 

.000 

.000 

S, DEV* 

4 . 832 

4*709 

3.771 

.000 

.000 

. 000 

N 

50 . 000 

48.000 

54.000 

.000 

. 000 

. 000 


141.320 

142.630 

150 . 400 

.000 

.000 

.000 

MINI MUM 

1 16.010 

o 

1 

122. 100 

. 000 

.000 

.000 

OALL groups COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER Vt 

iRIABLE) 


0 

OMEAN 132.032 

S. DEV. 5.2B3 


N 

MAXIMUM 

MINIMUM 


152. 

150.480 

116.010 


SUM OF SQUARES DF 
BETWEEN 265.6484 2 
WITHIN 3951.2595 149 
total 4216.9063 151 


MEAN SQUAP:E f RATIO 
132.3242 5.0087 

26.5185 


PROB. F EXCEEDED 
.0078 
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4 LMAXHDOT 


ITABULATION OF VARIABLE 


HUDNl HUD2 HUD3 

-I-. -I- . . . .-f + + 

MIDPOINTS 

5.000) 

4.000) 

3 . 000 > 

2 . 000 ) 

1 . 000 ) 

. 000 ) * 

- 1 . 000 )** *** ****** 

-2.000)******* ********12 ********19 

-3.000)********17 M*******17 H*******17 
-4 .000)M*******12 ********** ********* 

-5.000)********!! ***** 

- 6 . 000 ) * * 

-7.000) 

-8.000)* 

-9 ..000 ) 

1 0 . 000 ) * 

- 11 . 000 ) 

- 12 . 000 ) 

-r.j.ooo) 

-14,000) 

-15.000) 

GROUP MEANS ARE nENOTED BY H"S IF THEY COINCIDE WITH *'S. N'S OTHERWISE 


MEAN 

-3.534 

-3*025 

-2.787 

.000 

.000 

.000 

S. DEV. 

1.257 

1*193 

1.399 

.000 

.000 

.000 

N 

50.000 

43*000 

54.000 

.000 

.000 

.000 

MAXIMUM 

-1.200 

-*700 

-.400 

.000 

.000 

,00<; 

MINIMUM 

-8.400 

-5.600 

-9.700 

.000 

.000 

.000 

GALL GROUPS 

COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


0 


OMEAN -3.108 

S. DEV. 1.321 

N 152. 

MAXIMUM -.400 

MINIMUM -9.700 

DF MEAN SQUARE F RATIO PROB . F EXCEEDED 
2 7,4837 4,4846 .0128 

149 1.6687 

151 


SUM OF SQUARES 
BETWEEN 14.9673 

WITHIN 248,6424 

TOTAL 263.6096 
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SUPPLEMENTAL ANALYSIS AND CONSISTENCY 
TESTS 

A sequence of analyses of a data set are subject to many 
sources of variability, not all of which can be controlled for 
in an experimental design. The point of this section is to 
provide two supplemental analyses which deal with 
such variation. 

Thr first problem we consider is that the HUD2 display 
was slightly different for subject numbered 2, 9, 10, and 
11 than it was for other subjects. It is, therefore, of some 
importance to assess whether this change is liable to make a 
significant impact on the overall study. 

To assess this impact, a one-way ANOVA was done on 
just the data of subjects 2,9,10, and 1 1 . It was impractical 
to repeat the whole set of 32 possible response variable anal- 
yses, so a set of three sensitive variables were chosen for 
special analysis in both the precision and nonprecision 
cases. Together with the significance levels obtained those 
variables are the following: 


Variable 

Significance Level 

Precision 

Nonprecision 

AHDOTMAX 

AHDOTM 

AHDOTD 

0.0000** 

.2351 

.0000** 

0.0352* 

.0123** 

.0909* 


There were several motivations for choosing this group: 
(1) hi^ significance level in the whole design; (2) middle 
part of fli^t scenario data; and (3) basic physical impor- 
tance of the variable. Needless to say, other variables share 
these properties, but the conclusion is still likely to be the 
same. The data for subjects 2, 9, 10, and 11 do not seem to 
carry a different message from the overall data. Certainly, if 
one really wishes to assess the differences which do exist in 
these data, much more analysis is required. If one just 
wants a quick estimate of the impact of a change in these 
four subjects, a consideration of the next six histograms 
should provide tentative assurance. 
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«-ABULATION DF 

VARIABLE 

2 AHDOTMAX 

HUDPl 

HUD2 

HUD3 




MIDPOINTS 



-8.000) 



-10.000) 



-12.000) 


***** 

-14.000) 

«* 

»* 

r-16.000)*** 

******** 

M**** 

-18.000)* 

M**«« 

*** 

-20.000)*** 

***** 

«* 

-22.000)* 

* 


-24.000)M*** 


** 


-26.000)** 

-23.000)* 

-30.000) 

-32.000) 

-3-1.000) 

-36.000)** 

-38.000) 

— 10 , 000 ) 

GROUP MEANS ARE DEN'OTED BY M'S IF THEY COINCIDE WITH t'St N'S OTHERWISE 


1EAN 

-23.104 -17.S55 

-16.263 

.000 

.000 .000 

3. DEV. 

6.108 

2.100 

3.702 

.000 

.000 .000 

N 

17.000 

21.000 

19.000 

. 000 

.000 .000 

MAXIMUM 

-15.830 

■13.190 

-11 .940 

. 000 

.000 .000 

MINIMUM 

-36.680 - 

21.200 

-24.640 

.000 

. 000 . 000 

CALL GROUPS COMBINED (CASES EXCLUDED IF SPECIAL CODES 

FOR EITHER VARIABLE) 

OMEAN 

-18.779 





S. DEV. 

5.003 





N 

57. 





MAXIMUM 

-11.940 





MINIMUM 

—36 . 630 






SUM OF SQUARES 

DF 

MEAN SQUARE 

F RATIO 

PROB. F EXCEEDED 

BETWEEN 

469.7205 

2 

234.8602 

13.6118 

,0000 

WITHIN 

931.7224 

54 

17.2541 



TOTAL 

1401 . 4429 

56 
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ITABULATION OF VARIABLE 


3 AHDOTM 


HUDPl HUD2 HUD3 

+ + ..... + + + 

MIDPOINTS 

-5.000) 

- 6 . 000 ) 

-7.000) 

-S.OOO) 

-9.000) 


- 10 . 000 )** *** * 

- 11 . 000 )**** ******* ****** 

-12.000)* M** M** 

-13.000)M** ******* ******* 

-14.000)***** * 

-15.000)** * 

-16.000) 

-17.000) * 

-13.000) 

-19.000) 

- 20 . 000 ) 

- 21 . 000 ) 


•3R0UP MEANS 

ARE DENOTED BY 

M'S 

IF THEY COINCIDE 

WITH 

*'Sf N'S OTHERWISE 

MEAN 

-12.709 -11. 

85S 

-12.324 

.000 

.000 

,000 

S. DEV. 

1.675 1. 

185 

1.704 

.000 

.000 

.000 

N 

17.000 21. 

000 

19.000 

.000 

.000 

.000 

MAXIMUM 

-10.220 -10. 

100 

-10.470 

.000 

.000 

,000 

MINIMUM 

-15.320 -13. 

750 

-16.840 

.000 

.000 

• 000 

jAll groups 

COMBINED (CASES 

EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VAf<IABLE) 

✓ 

)MEAN 

-12.267 






S. DEV* 

1.536 






N 

57. 






MAXIMUM 

-10.100 






minimum 

-16.840 






SUM OF SQUARES 

DF 

MF-AN SQUARE F 

RATIO 

PROB. F 

EXCEEDED 

BETWEEN 

6.9008 


3 . 4504 

1 .4873 

.23 

51 

WITHIN 

125.2780 

54 

2.3200 




TOTAL 

132.1788 

56 
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lTr*E!ULATION OF VARIABLE 


4 AHDOTIi 


HUDPl HUD2 HUD3 


MIDPOINTS 

14.000) 

13.000) 

12.000) 
11,000) 
10,000)* 

9.000) 

8 . 000 ) * 

7 . 000 ) 

6 . 000 ) *** 

5.000) M#** 

4 . 000 ) ** 

3 . 000 ) ***** 

2 , 000 ) * 

1 . 000 ) 

. 000 ) 

-IvOOO) 

-2,000) 

GROUP HFANS ARE 


+ + I- . . . + 


** ** 

M*****.**12 *** 
******* h**** 

********* 


DENOTED BY M'S 


IF THEY COINCIDE WITH *'Sr 


+ 


N'S OTHERWISE 


MEAN 

4.798 

2.763 

1.346 

.000 

. 000 

.000 

S, DEV. 

2.133 

,630 

1.062 

.000 

.000 

. 000 

N 

17.000 

21.000 

19.000 

.000 

.000 

.000 

MAXIMUM 

10.320 

4.040 

4.190 

.000 

.000 

.000 

MINIMUM 

2.090 

1.630 

.750 

.000 

,000 

.000 

>ALL GROUPS COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES FOR 

EITHER 

VARIABLE) 




■JMEAN 

3.064 


S, DEV. 

1.811 


N 

57. 


MAXIMUM 

10.320 


MINIMUM 

.750 



SUM OF SQUARES 

DF 

BETWEEN 

81.2055 

- 2 

WITHIN 

102.3974 

54 

TOTAL 

183.6029 

56 


MEAN SQUARE F RATIO PROD, F EXCEEDED 
40.6027 21.4121 .0000 

1,8962 
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IIABULATION OF VARIABLE 


2 AHDOTHAX 


HUDNl HUII2 

. + . » . . 

MIDPOINTS 

-14.000) 

-16.000) 

-18.000)* 


HUD3 

. . . • 


+ 


+ 


+ 


- 20 . 000 )****** 

-22.000)M**** 

-24.000)***** 


* 

******** ********11 
«*** M.**** 


-26.000)** 

-28.000) 

-30.000) 

-32.000) 

-34.000)* 

-36.000) 

-38.000) 

-40.000) 

-42.000) 


M* *** 

** * 

* * 

* 


* 


-44.000) * 

-46.000) 

GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH *'S». N'S OTHERWISE 


MEAN 

-22.681 

-26.229 

-23.406 

.000 

.000 

.000 

S. DEV. 

3 .417 

6.687 

2.250 

.000 

.000 

.000 

N 

20.000 

20.000 

22.000 

.000 

.000 

.000 

MAXIMUM 

-18.380 

-21.040 

-20.990 

. 000 

.000 

.000 

MINIMUM 

-33.160 

-43.970 

-29.420 

.000 

.000 

.000 


CALL GROUPS COMBINED (CASES EXCLUDED IF SPECIAL CODES FOR EITHER VARIABLE) 
0 


OMEAN 
S. DEV. 
N 

MAXIMUM 

MINIMUM 


-24.083 

4.6S1 

62. 

-13.380 

-43.970 


i-L TWEEN 

WITHIN 

TOTAL 


SUM OF SQUARES DF 
141.5063 2 

1177.8120 59 

1319.3181 61 


MEAN SQUARE F RATIO 

PROB. F EXCEEDED 

70.7531 3.5442 

.0352 

19.9629 
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] TABULATION OF UARIABLE 


3 AHLiOTN 


HUDNl 

HUD2 

HUD 3 

MIDPOINTS 

-9.000) 

-10.000) 

-11.000) 

-12.000)* 

-13.000)* 



-14.000)* 

♦ *** 


-15.000)******* 

**** 


-1<S.OOO)M**** 



-17.000)** 

tM 

M**** 

-18.000)** 



-19.000)* 


*** 

-20.000) 


* 

-21.000) 


»* 

-22.000) 


* 

-23.000) 

-24.000) 

-25.000) 




GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH *'S» N'S OTHERWISE 


MEAN 

-15.560 -15.570 

-17.142 

,000 

.000 ,000 

S. DEV. 

1,641 1.635 

2.365 

.000 

.000 .000 

N 

20.000 20.000 

22.000 

.000 

.000 .000 

MAXIMUM 

-11,980 -12.910 

-14,080 

.000 

.000 .000 

MINIMUM 

-13.890 -13,340 

-22.200 

.000 

.000 .000 

OAUL GROUPS 

COMBINED (CAGES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER VARIABLE) 

0 

OMEAN 

-16,125 




S. DEV, 

2.043 




N 

62. 




MAXIMUM 

-11.980 




MINIMUM 

-22.200 




SUM 

OF SQUARES DF 

MEAN SQUARE F 

RATIO 

PROB. F EXCEEDED 

BETWEEN 

35.2761 2 

17.6331 4 

,7427 

.0123 

WITHIN 

219.4201 59 

3.7190 



TOTAL 

254.6962 61 
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•ABULATION OF VARIABLE 


4 AHnOTD 


HUDNl 

HUD2 

HUD3 




MIDPOINTS 

17.000) 

16.000) 

* 


15.000) 

14.000) 

13.000) 

12.000) 

11.000) 

«* 


10.000)* 

9.000) 

** 

* 

n.ooo)* 

** 

* 

7.000)* 


****** 

6.000)t 

N 

*** 

5,000) 


mt 

A 


* 

3.000)***** 

** 


2.000)***** 

»**» 

** 

1,000) 




GROUP MEANS ARE BENOTED BY M'S IF THEY COINCIDE WITH *'S» 


+ 


N'S OTHERWISE 


- — iEAN 

4.066 

6.082 

4.942 

.000 

.000 

.000 

3. DEV. 

2.180 

3,816 

2.352 

,000 

.000 

.000 

N 

20.000 

20.000 

22.000 

,000 

,000 

,000 

MAXIMUM 

9,580 

15.850 

8.560 

.000 

.000 

.000 

MINIMUM 

2.180 

1 . 550 

1 . 160 

,000 

,000 

.000 

GALL GROUPS COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


0 


OMEAN 
3. DEV, 
N 


3.027 

2,931 

62. 


MAXIMUM 15.350 

MINIMUM 1.160 



SUM OF SQUARES 

DF 

BETWEEN 

40.9099 

r> 

WITHIN 

433.1702 

59 

TOTAL 

524.0801 

6). 


MEAN SOUARE F RATIO 
20.4550 2,4978 

8,1893 


F'ROB. F EXCEEDED 
.0909 
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The second problem addressed in this section is that of 
whether one should include the anomaly and missed 
approach data in the analysis of the APPROACH segment 
data. To resolve this, and also for another benefit to be dis- 
cussed in a moment, an analysis of the APPROACH seg- 
ment (precision and nonprecision) was conducted on all 
available responses. The list of variables (and levels of 
significance) are as follows: 


SIGNIFICANCE TABLE: 
ALTERNATE APPROACH DATA 


Variable 

Significance Level 

Precision 

Nonprecision 

ALOC 

0.0762 

0.0000** 

AGS 

.0000** 

.0310 

AEASM 

.1079 

.0887 

AEASD 

.5056 

.9204 

AHDOTMAX 

.0000** 

.3804 

AHDOTM 

.0210* 

.0000** 

AHDOTD 

.0000** 

.9616 


The histograms and detailed ANOVA for the preceding 
variables are listed below. The importance of this special 
analysis for the whole data set is now revealed by compar- 
ison with the first table of significance given in the section 
“Introduction to the Principal Analysis.” The pattern of 
significance is essentially identical in both the data sets. The 
main implication is that this data set is highly robust to the 
inclusion/deletion of observations on the basis of the sub- 
sequent development of missed approach or anomaly. 
Although no comparative analysis was made, it is quite 
likely that a similar conclusion holds for the marker vari- 
ables and much of the data in the decision segment. In 
particular, all of the significance levels reported in any of 
the tables of this report are almost certain to be impervious 
to deletion (or insertion) of a modest number of observa- 
tions. This is a very sensible property for a design to possess. 
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ITABULATIQN OF VARIABLE 4 ALOC 


HUDPl 


HUD2 


HUBS 


MIDPOINTS 

1.330) 

1 . 260 ) 

1.190) 

1 . 120 ) 

1.050) 

.980) 

.910) 

.840) 

.770) 

,7< ) 

.630) 

.560) 

.490)* 

.420)* 

.350)* 

.280)** 

. 210 )**** 

. 140)M*******20 
. 070 ) **»****»24 
-. 000 )** 

-.070) 

-.140) 


********* 
li*******36 
**: 4 (»»«*« 1 1 


* 

« 

« 

**** 

M*******27 

********25 


GROUP MEANS 

ARE DENOTED 

BY M'S 

IF THEY COINCIDE 

WITH : 

MEAN 

. 129 

.087 

.077 

.000 

S. DEV. 

.090 

. 140 

. 146 

.000 

N 

55.000 5 

18.000 

60.000 

.000 

MAXIMUM 

.520 

1.090 

1.040 

.000 

MINIMUM 

.030 

.010 

.010 

.000 

OALL GROUPS 

A 

COMBINED (CASES EXCLUDED IF SPECIAL 

CODES 1 

OMEAN 

.097 




S. DEV. 

. 130 




N 

173. 




MAXIMUM 

1.090 




MINIMUM 

.010 




SUM OF SQUARES 

DF 

MEAN SQUARE F 

RATIO 

BETWEEN 

.0866 

r> 

.0433 

2.6142 

WITHIN 

2.8160 

170 

.0166 


TOTAL 

2.9026 

172 




*'S» N'S OTHERWISE 


FOR 


.000 

.000 

.000 

.000 

.000 

EITHER 


.000 

.000 

.000 

.000 

.000 

VARIABLE) 


PROB. F EXCEEDED 
.0762 
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I 



ITABULATION OF VARIABLE 


2 'AGS 


HlJDF-1 HUD2 HUD3 

+ + + + 

MIDPOINTS 

.600) 

,570) 

,540) 

.510)* 

.480) 

.450) 

.420) 

.390) 

.360) 


,330) * 

.300) 

.270)** 

.240)* * 

. 210 )** * * 

.180)***** * 

.150)* * 


. 120)M*****»* ***** 

.0?0)********19 ********* **«* 

.060)*****«»*13 M*«*»«**21 H*«»«***i6 
.030)*** ********21 ********34 

. 000 ) ** 

-.030) 

GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH t'Sr N'S OTHERUISE 


MEAN 

.112 

.065 

.051 

.000 

.000 

.000 

S. DEV. 

.077 

.043 

.052 

.000 

,000 

.000 

N 

55.000 58 

.000 

60.000 

.000 

.000 

.000 

MAXIMUM 

.510 

.250 

.320 

.000 

.000 

.000 

MINIMUM 

.030 

.020 

.010 

.000 

.000 

.000 

•ALL GROUP 
1 

S COMBINED (CASES EXCLUDED IF SPECIAL 

CODES FOR 

EITHER VARIABLE) 

I 

• MEAN 

.075 






S . DEV . 

.064 






N 

173. 






MAXIMUM 

.510 






MINIMUM 

.010 







SUM OF SQUARES 

DF 

MEAN SQUARE 

F RATIO 

PROB. 

F EXCEEDED 

BETWEEN 

.1174 

2 

.0587 

16.9419 

♦ 

0000 

UITHIN 

.5891 

170 

.0035 




TOTAL 

.7065 

172 
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1 TABULATION OF VARIABLE 


3 AiEASM 


HUDPl 

• 

HUD2 

4 . .... 4 - 

HUD3 

MIDPOINTS 

157.500) 

156.000) 

154.500) '« 

153.000) 



151 ,500)*« 

« 


150.000)* 

% 


148.500) 



147,000)**** 


« 

145,500)*** 

** 


144,000)* 

«» 

**** 

142.500)*# 


«** 

141 ,000)***** 

**** 

****** 

139.500)M** 

**«»**»** 

**** 

138.000)#****** 

*** 

M*»*** 

136, 500-)****** 

M*#** 

*«**»«**» 

135.000 ) ********* 

********12 

***** 

133,500)****#* 

********* 

********11 

132,000) 

********* 

******* 

130.500)*** 

129.000) *# 
127 ,.500) 

126.000) 

* 

*« 


GROUP MEANS ARE DENOTED BY M'S IF THEY GOINCIDE WITH »'S» 


+ 


N'S OTHERWISE 


MEAN 

138,787 

136.921 

137.294 

..000 

,000 

.000 

S* DEV. 

5^963 

4.478 

4.251 

..000 

sOOO 

.000 

N 

55.000 

58.000 

60.000 

sOOO 

sOOO 

.*000 

MAXIMUM 

154,500 

151.790 

148.320 

.000 

.000 

..000 

MINIMUM 

128. Q60 

130.540 

130.790 

.000 

..000 

• 000 


•ALL GROUPS COMBINED (CASES EXCLUDED IF SPECIAL CODES FOR EITHER VARIABLE) 


• MEAN 

S. DEV. 

N 

MAXIMUM 

MINIMUM 


137 ..644 
4,965 
173.. 
154.500 
128.860 


between 

WITHIN 

total 


SUM OF SQUARES 
109.6192 
4129,6289 
4239,2461 


DF 

i-70 

172 


MEAN SQUARE 
54 ,.8096 
24 ,.2919 


F RATIO 
2^2563 


PROB . F EXCEEDED 
. 1079 
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ITABULATION OF VARIABLE 


4 AeaSD 


HUDPl 


HUD2 


HU03 


HIDPOINTS 
16.000) 

15. 000) 

14.000) 

13.000) 

12 . 000 ) 

11 . 000 ) 

10 . 000 ) 

9.000) 

8 . 000 ) * 

7.000) 

6 . 000 ) ** 

5.000) **** 

4.000) ********* 

3.000) M*******19 

2 . 000 ) ******** 1 6 

1 . 000 )**** 

. 000 ) 

- 1 . 000 ) 

- 2 . 000 ) 

-3.000) 

-4.000) 

-5.000) 

GROUP MEANS ARE DENOTED 


* 

**** 

**** 

*** 

H»******17 

********20 

******** 


* 

*** 

* 

********11 

M*****.**i4 

********21 

**«««**** 


BY M'S IF THEY COINCIDE WITH *'S» N'S OTHERWISE 


MEAN 
S. DEV, 
N 

MAXIMUM 

MINIMUM 


3.075 
1.326 
55,000 
8.000 
1 . 170 


2.951 

1.710 

58.000 

10,140 

.740 


2.753 

1.403 

60.000 

7.370 

.540 


OALL GROUPS COMBINED 
0 

OMEAN 2,922 

S. DEV. 1.488 

N 173. 

MAXIMUM 10.140 

MINIMUM .540 


(CASES EXCLUDED IF SPECIAL 


.000 

.000 

.000 

.000 

.000 

CODES FOR 


.000 

.000 

,000 

.000 

,000 

EITHER 


.000 

.000 

.000 

.000 

.000 

VARIABLE) 


SUM OF SQUARES DF 
BETWEEN 3.0433 2 
WITHIN 377.8228 170 
TOTAL 380.8660 172 


MEAN SQUARE 
1.5216 
2.2225 


RATIO PROS. F EXCEEDED 
.6847 .5056 
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ITABULATION OF. VARIABLE 


2 AHDOTMAX 


HUDPl HUD2 HUD3 

-i- -i- + + 

MIDPOINTS 

-9.000) 

-10.500) 


- 12 . 000 ) 

-13.500) 

-15.000)**# 

-16.500)******* 

-18.000)***** 

-19.500)****** 

- 21 . 000 )****** 

- 22.500)M** 

-24.000)******* 

-25.500)****** 

-27.000)** 

-28.500)* 

-30.000)*** 

-31.500)* 

-33.000)** 

-34.500) 

-36.000)** 

-37.500) 


*»««**:tc*12 
****** « 4 (**** 

***** t****K. 

********17 M*******17 
M******** ********** 

******* ***** 

****** 

*** 

*** *** 

* 

* 


* 


-39.000) 

-40.500)* 

GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH *'Sf N'S OTHERWISE 


MEAN 

-22.970 ,-18.157 

-16.354 

.000 

.000 

.000 

S. DEV. 

5.799 3.280 

3.762 

.000 

,000 

.000 

N 

55.000 58.000 

60.000 

,000 

.000 

.000 

MAXIMUM 

-14.740 -12,920 

-11 .470 

,000 

,000 

.000 

MINIMUM 

-40.030 -28.720 

-34.390 

.000 

.000 

.000 

OALL GROUPS 

COMBINED (CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 

OMEAN 

-19.062 





S. DEV. 

5.167 





N 

173. 





MAXIMUM 

-11.470 





MINIMUM 

-40.030 







SUM OF SQUARES 

DF 

MEAN SQUARE 

F RATIO 

PROB. F EXCEEDED 

BETWEEN 

1327.2209 

2 

663.6104 

34.5597 

.0000 

WITHIN 

3264.3132 

170 

19.2018 



TOTAL 

4591.5313 

172 
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ITABULATION OF VARIABLE 


3 AHDOTM 


HU DPI 


MIDPOINTS 

-4,000) 

-5.000) 

- 6 . 000 ) 

- 7 . 000 ) 


HUD 2 

+ . . » . 


HUD3 

+ » « » . 


+ 


+ 


+ 


- 8 . 000 ) 

-9*000)» ** 

-10.000)«4c*« **.*t***t 

-11 .000)*****»»*15 ********21 ********15 
-12.000)********* M********* Vl*******14 

-13.000)M***** ********** ********18 

-14.000)********* *** **** 

-15*000)******** *** * 

-16.000)* * * 

-17.000) * 

-18.000) 

-19.000)* 

- 20 , 000 ) * 


- 21 , 000 )* 

- 22 . 000 ) 

-23.000) 

-24.000) 

-25.000) 

GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE U I TH *'S» N'S OTHERWISE 


MEAN 

-12,790 -11.818 

-12.310 

.000 

.000 

.000 

S. DEV, 

2.188 1.493 

1.785 

,000 

.000 

.000 

N 

55.000 58.000 

60.000 

,000 

.000 

.000 

MAXIMUM 

-9.260 -8.810 

-9.580 

.000 

.000 

.000 

MINIMUM 

-21.030 -16.170 

-20.040 

.000 

.000 

.000 

OALL GROUPS 

A 

COMBINED (CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 

OMEAN 

-12.297 





S. DEV. 

1.868 





N 

173. 





MAXIMUM 

-8.810 





MINIMUM 

-21.030 







SUM OF SQUARES 

DF 

MEAN SQUARE F RATIO 

PROB. F EXCEEDED 

BETWEEN 

26.6694 


13.3347 3.9514 

. 0210 

WITHIN 

573.6877 

170 

3 *374A 


TOTAL 

600.3569 

172 
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1 TABULA ON OF VARIABLE 


4 AHDOTD 


HUDfU 


HUD2 


MUD 3 


MIDPOINTS 

17.000) 

16.000) 

15.000) 

14.000) 

13.000) 

12 . 000 ) * 

11,000) 

10 . 000 )** 

9.000) * 

8 . 000 ) **** 

7.000) ***** 

6 . 000 ) ***** 

5.000) M*******11 

4 .000) ********** 

3.000) «***«***12 

2 . 000 ) **** 

1 . 000 ) 

. 000 ) 

- 1 . 000 ) 

- 2 . 000 ) 

-3.000) 

-4.000) 

GROUP MEANS ARE DENOTED 


«** 

****** 

****** 

(1*******23 

*««**«**18 

** 


*** 

*****:((** 

M»******26 

********22 


BY M'S IF THEY COINCIDE WITH 


N'S OTHERWISE 


MEAN 

5.069 

3. 120 

1.926 

.000 

.000 

.000 

S. DEV. 

2.269 

1.179 

1 .003 

.000 

.000 

.000 

N 

55,000 

58.000 

60.000 

.000 

.000 

.000 

MAXIMUM 

12.100 

6.220 

6.390 

.000 

.000 

.000 

MINIMUM 

2.090 

1 . 130 

.750 

.000 

.000 

.000 

OALL GROUPS COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


0 

OMEAN 
S. DEV. 
N 

MAXIMUM 

MINIMUM 


3.326 

2.023 

173. 

12.100 

.750 


SUM OF SQUARES DF 
BETWEEN 287.1079 2 
WITHIN 416.7695 170 
TOTAL 703.8774 172 


MEAN SQUARE F RATIO 
143.5540 58.5556 

2.4516 


PROB. F EXCEEDED 
.0000 
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1 TABULATION OF VARIABLE 


A ALOC 


HUDNI 


MIDPOINTS 
,950) 
,900) 
,850) 
.800)* 
.750) 
.700) 
.650) 
.600)* 
.55' ) 
.500) 
.450)* 
,400) 
.350)** 
.300)** 
.250)** 


HUD2 
^ . 


« 


HUD3 

+ . . . . 


* 


* 

* 

* 


. 200 >*» *« 

. 1S0)M********* * *** 


+ 


+ + 


. 100) ********18 ******** ***** 

.050)********14 M«******33 H*******27 
-.000)*** »«»»*«*»17 *«»**«**18 

-.050) 

-. 100 ) 

GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE UITH *'S» N'S OTHERWISE 


MEAN 

.143 

,051 

.072 

.000 

.000 

.000 

S. DEV. 

.143 

.041 

,089 

.000 

.000 

,000 

N 

56.000 

60.000 

59.000 

.000 

.000 

,000 

MAXIMUM 

.810 

.270 

.490 

.000 

.000 

,000 

M-NIMUM 

.010 

.010 

.010 

.000 

,000 

.000 

OALL GROUPS COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


0 

OMEAN 
S. DEV. 
N 

MAXIMUM 

MINIMUM 


.087 

.106 

175. 

.810 

.010 


SUM OF SQUARES DF 
BETWEEN .2647 2 
WITHIN 1.6810 172 
total 1.9457 174 


MEAN SQUARE F RATIO 
.1323 13.5402 

.0098 


PROS. F EXCEEDED 
.0000 
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ITABULATION OF yARIABLE 


2 AGS 


HUDNl 

HUD2 

HUD3 

-t- 

MIDPOINTS 

1.470) 

1.400) 

1.330) 

1.260)* 

1,190)* 

1.120) 

1.050)* 

.?80)»** 

** 

* 

.910) 

*** 

**** 

o 

CO 

• 

*** 

** 

.770) 

*** 

***** 

.700)** 

**** 

********* 

.630)***** 

»«** 

********11 

.560)**** 

***** 

M 

.490)**** 

M*** 

******* 

,420)M«** 

******* 

« 

.350)******* 

********** 

********** 

. 280 )********** 

** 

****** 

.210)«**»»»*«* 
. 140)*** 

.070)* 

.000) 

********** 

** 

* 

** 


+ 


GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH t'St N'S OTHERWISE 


MEAN 

.451 

.486 

.569 

.000 

.000 

.000 

S. DEV. 

.275 

.247 

.213 

.000 

.000 

.000 

N 

56.000 

60.000 

59.000 

.000 

.000 

.000 

MAXIMUM 

1.240 

1.050 

1.150 

,000 

.000 

.000 

MINIMUM 

. 100 

.090 

.200 

.000 

.000 

.000 

OALL GROUP 

COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


5MEAN ,503 

S. DEV. ,24? 

N 175. 

MAXIMUM 1.240 

MINIMUM .090 



SUM OF SQUARES 

DF 

MEAN 

BETWEEN 

.4286 

2 


WITHIN 

10.3944 

172 


TOTAL 

10.8230 

174 



SQUARE F RATIO PROB. F EXCEEDED 
,2143 3,5462 ,0310 

.0604 
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UrtBULATION OF VARIABLE 


3 AiEASM 


HUDNi 

HUD2 

HUD3 

MIDPOINTS 

156.000) 
154.500) 

153.000) ** 

. + 

4 

151 .500)* 

«« 


150.000)* 

148.500)** 



147.000) 



14S.500)*** 


t 

144.000)*** 

« 

* 

142.500 )********* 

****** 

»** 

141 .000)***** 

********* 

** 

139.500)M******** 

****** 

******* 

133.000)*** 

M******* 

M********* 

136.500)***** 

********12 

********16 

135.000)**** 

X»******12 

********* 

133.500)***** 

*** 

*** 

132.000) * 

130.500) ** 

129.000) 

127.500) 

126.000) * 

124.500) 

« 

** 


■^ROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH »'S» N'S OTHERWISE 


MEAN 

140.001 

138^398 

138 ..320 

sOOO 

..000 

hOOO 

S. DEV. 

5^674 

3.811 

4.086 

.000 

.000 

,000 

N 

56.000 

60.000 

59.000 

..000 

.,000 

.,000 

MAXIMUM 

153.650 

152.130 

150.400 

hOOO 

.000 

hOOO 

MINIMUM 

126.100 

132.420 

131.930 

hOOO 

.000 

.000 

)ALL GROUPS COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


) 


)MEAN 138.885 

S. DEV. 4,611 

N 175. 

MAXIMUM 153.650 

MINIMUM 126.100 

SUM OF SQUARES 
BETWEEN 102„7455 

WITHIN 3596s2952 

TOTAL 3699.0405 


MEAN SQUARE F RATIO 
51,3727 2„4570 

20^9007 


PROS. F EXCEEDED 
,0887 
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ITABULATION OF VARIABLE 


4 OEASn 


HUDNI HUD2 

.... + ....... 

rtiriPOINTS 
16.000) 

15. 000) 

14.000) 

13.000) 

12 . 000 ) 

11 . 000 ) 

lO.OOO) 

9.000) ♦ 

8 . 000 ) 

7.000) * 

6.000>*»« * 

5.000) ******* *** 

4.000) ********* ********* 

3.000) M*** M*».***! 

2.000) ********18 ******: 

1 .000)********13 * 

. 000 )* 

- 1 . 000 ) 

- 2 . 000 ) 

-3.000) 

-4.000) 

-S.OOO) 

GROUP MEANS ARE DENOTED BY 


HUD3 


******* 


M*******ia M*'******22 
********27 ********24 


IF THEY COINCIDE UITH *'S» 


OTHERWISE 


MEAN 

2.832 

2.914 

2.818 

.000 

.000 

.000 

S. DEV. 

1 .653 

1.273 

1.203 

.000 

.000 

.000 

N 

56.000 

60.000 

59.000 

.000 

.000 

.000 

MAXIMUh 

7.120 

8.780 

8.950 

.000 

.000 

.000 

MINIMUM 

.500 

1.470 

1.210 

.000 

.000 

.000 

)ALL GROUPS COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


>MEAN 
S. DEV. 
N 

MAXIMUM 

MINIMUM 


2.855 

1.377 

175. 

8.950 

.500 


SUM OF SQUARES 
BETWEEN .3183 

WITHIN 329.8474 

TOTAL 330.1655 


MEAN SQUARE 
.1592 
1.9177 


RATIO PROS. F EXCEEDED 
.0830 .9204 
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ITABULATION OF VARIABLE 


2 AHDOTMAX 


HUDNl HUD2 HUBS 

<f + + 4- . . . . 

MIDPOINTS 

12 . 000 ) 

9.000) 

6 . 000 ) 

3 . 000 ) 

, 000 )* 

-3.000) 

- 6 . 000 ) 

-9.000) 

- 12 . 000 ) 

-15.000) » 

-18.000)***** «««««« t**' 

-21 .000)****»***14 ***»****19 »**#***»22 
-24 .000)M*i*»**#16 M****»**16 M»»»****21 
-27.000)****** ********* #******#» 

-30.000'*** ***** *** 

-33.000)**** »» * 

-36.000)# 

-39.000)** 

-42 ..000)** * 

-45.000) * 

-4S.OOO) 

-31.000) 

GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE UITH *'Sr 


N'S OTHERWISE 


MEAN 

-24.806 

-24.257 

-23.456 

.000 

.000 

.000 

S. DEV. 

6.882 

5.232 

2.773 

.000 

.000 

.000 

N 

54.000 

60.000 

59.000 

.000 

.000 

.000 

MAXIMUM 

.000 

-16.470 

-18.900 

.000 

.000 

.000 

MINIMUM 

-40.760 

-43.970 

-31.520 

.000 

.000 

.000 

OALL GROUPS COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


0 

OMEAN 
S. DEV. 
N 

MA-;iMUM 

MINIMUM 


5.185 

173. 

.000 

-43.970 


SUM OF SQUARES DF 
BETWEEN 52.2779 

WITHIN 4571.2695 170 

TOTAL 4623.5469 172 


MEAN SQUARE F RATIO PROB. F EXCEEDED 
26.1389 .9721 .3804 

26.8898 
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ITABULATION OF VARIABLE 


3 AHDOTM 



MEAN 

-15.161 

-15.236 

-17.022 

.000 

.000 

.000 

S. DEV. 

2.756 

2.059 

2.183 

.000 

.000 

.000 

N 

54.000 

60.000 

59.000 

.000 

.000 

.000 

MAXIMUM 

.000 

-8,950 

-11.120 

.000 

.000 

.000 

MINIMUM 

-19.720 

-18.900 

-22 . 200 

.000 

.000 

.000 

OALL GROUPS 

COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


OMEAN -15.321 

S. DEV, 2.481 

N 173. 

MAXIMUM .000 

MINIMUM -22.200 


SUM or SQUARES DF MEAN SQUARE F RATIO PROB. F EXCEEDED 
BETWEEN 129.1640 2 64.5820 11.8127 .0000 

WITHIN 929.4158 170 5.4672 

TOTAL 1058.5796 172 
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ITABULATION OF VARIABLE 

4 AHDOTD 




HUDNl 

HUD2 

HUD3 




+ 



+ 

F 

MIDPOINTS 






19.000) 

18.000) 

17.000) 

16.000) 
15.000) 

t 





14.000) 

13.000) * 

12.000) 
11.000)* 

** 





10.000)*** 

*« 

*** 




9.000)** 


* 




8.000)****** 

** 

*** 




7.000)* 

***** 

********** 




6.000)**** 

***** 

**»*«««« 




5.000)M*** 

M****** 

M******** 




4. 000) ********15 

********13 

****** 




3.000)******** 


******* 




2.000)******** 

t*t*****iz 

******** 




1.000) 


**** 




.000)* 






-1 .000) 
-2.000) 






GROUP MEANS ARE DENOTED BY M'S 

IF THEY COINCIDE 

WITH 

*'S. N'S OTHERWISE 

MEAN 5.074 

5.034 

4.937 

.000 

.000 

.000 

S. DEV. 2.839 

2.837 

2.346 

.000 

.000 

.000 

N 54.000 

60.000 

59.000 

.000 

.000 

.000 

MAXIMUM 13.460 

15.850 

10.240 

.000 

.000 

.000 

MINIMUM .000 

1.550 

1.160 

.000 

.000 

.000 

CALL GROUPS COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 

0 






OMEAN 5.013 





S . DEV . 2 . 665 





N 173. 






MAXIMUM 15.8 

50 





MINIMUM .000 





SUM OF SaUARES DF 

MEAN SQUARE F 

RATIO 

PROS. F 

EXCEEDED 

BETWEEN .5620 

2 

.2810 

.0391 

.9616 1 

WITHIN 1221.1746 

170 

7.1834 




TOTAL 1221.7366 

172 
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GENERAL CONCLUSION 


The clear conclusion is that from a statistical point of 
view, there are very real differences in the three displays 
that have been studied. The tables given allow one quickly 
to obtain point and interval estimates of many contrasts of 
interest. These, in turn, are the first steps of any planning 
or engineering appraisal. 


Clearly, there are many questions which are left. This 
report should help focus those questions, and the designed 
data set should still be able to help bring about their resolu- 
tion. This is the highest level to which a shot gun approach 
can lead. The next questions need to be sharply posed. The 
data obtained in HUD phase III will remain a tremendous 
resource in that subsequent investigation. 
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SUPPLEMENTAL PARAMETER ANALYSIS 
FAA/NASA HEAD-UP DISPLAYS - PHASE HI 


J. Michael Steele 
Control Analysis Corp, 
May 28, 1980 


PURPOSE AND STRUCTURE 


This report is intended to supplement the Experimental 
Design and Statistical Analysis FAA/NASA Head-up 
Displays: Final Report The principal objective here is to 
conduct an analysis of variance and provide histograms for 
nine response variables of secondary interest which were 
not included in the analyses of the Final Report 

As in that report, the analyses here are separated accord- 
ing to precision and nonprecision flight conditions. Each of 
the two sections is preceded with a list of the parameters 
studied with an indication of the significance level of the 
corresponding F-test. This table of significance levels is 
intended to guide the reader in his consideration of the full 
data as presented in the histograms which follow the table. 

In the second section (Nonprecision), there are three 
additional analyses made which are given in order to assist 
the reader in the understanding of the impact of out-liers 
on the analyses. The point confirmed by these repeated 
studies is that single out-liers in this data set apparently 
have a very minor influence on the resulting levels of signifi- 
cance. More details of this observation are made at the end 
of the section. 


After the two analysis sections, there is a brief conclu- 
sion. The statements made there confirm the earlier com- 
ments of the Final Report 

Precision Flights 

The levels of significance of the variables studied here 
under precision conditions are given below. As usual, the 
symbols ♦ and ** are used to signal significance levels 
beyond 0.05 and 0.01, respectively. The histograms and 
ANOVA tables of these variables follow directly in the 
same order. 


Variable 

Significance Ia 

OMHDOT 

Q&199 

MMALT 

.0009** 

MMYCG 

.0330* 

MMVQVR 

.2268 

MMHDOT 

.3170 

IMALT 

.0011** 

IMYCG 

.0037** 

IMVQVR 

.3040 

IMHDOT 

5734 
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TA&ULATIDN OF VARIABLE 


2 OfiHi'iC.* T 


HUDPl 


HUD2 


HUD3 


MIDPOINTS 
27 » 000) 

24 » 000) 

21 .000> * 

19*000) 

15. 000) :*; 

12.000) ■* 

9.000) * 

6 . 000 ) « 

3. 000 )»****♦ ■# 

. 000 )*** #* 

-3.000)***** **** 

- 6 . 000 )*** ****** 

-9 . 000 ) M******** 

-12.000 ) ** * .K* i * * * * 

-16 . 000 ) t;*****.**. **4^* 

-18. 000 ) ^ A. 

-Zi,0’>0}*'r * 1 =*** 

-2.4. 000)**** i* 

-27.000)* ** 

-30 . 000 > 

-33.000) 

-36 . 000 ) * 

iTRuUP MEANS ARE Db-JQTED BV M' 


# 

«* 

»** 

*SU**** 

H******* I 3 M**** ♦•* >! 24 
******** i 1 *** *****11 

* 


IF THEY COINCIDE WITH *'Sr N'S OTHERWISE 


MEAN 
S . DEV . 

W 

MAXIMUM 
MINIMUM 
OALL GRDL 
0 

OMEAN 
S. DEV. 
N 

MAXIMUM 

MINIMUM 


-10.050 

-10.469 

-9.7^12 

.000 

.000 

.000 

9,102 

8.776 

4 * ft A3 

♦ 000 

.000 

. 000 

58 - 000 

58 . 000 

60. 000 

. 000 

. OoO 

. 000 

13.900 

20.800 

2.300 

.000 

. 000 

.000 

—34 . 600 

-26.200 

-21 .600 

. 000 

.000 

♦ 000 

COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


-10.086 
7 . 689 
176. 

20.300 

-34.600 



SUM OF SQUARES 

DF 

MEAN SQUARE 

F RATIO 

BETWEEN 

15.j2a82 

2 

7,6^41 

. 1230 

WITHIN 

10330.6016 

173 

59 ..7 144 


TOTAL 

10345.8867 

175 




PROP. F EXCEEDED 
.8799 
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5. TABULATION OF VARIABLE 


3 MMALT 


HUDPl HUD2 HUD3 

».*»«*.*.* + 4 - 

MII'POTNTS 

322.000) 

315.000) 

308. 000) ;^. 

301.000) 

294.000) 

297.000) 4C 

280.000) «)i' 

273.000) 

200 . 000 ) « 

»9.000>*»>r.*;’if *** 

2S2 *000 mtilii** 

24S*OOOrtftm*.t #♦##** »»** 

238.000 ) f1^::^» 

231 .000) *t»;+;Lmi3 M*****<i#ll H***t*M*21 

224.000) !f Ji‘***#*:T.** ic#******!! **lt##***.17 

2l7.000>:4)!<tv<; *** 

210.000 >X 
203 . 000 * 

196.000 6 

189 . 000 ) 

182.000) 

175 . 000 ) 

NEANr. ARE DENOTED BY M'S IF THEY COINCIDE WITH t'St N'S OTHERWISE 


n£AN 

239.707 

234.345 

229.733 

.000 

.000 

.000 

S* DEM* 

19.210 

13.847 

7.059 

.000 

.000 

.000 

i'v 

58 . 000 

58 . 000 

60.000 

.000 

.000 

.000 

j r1Uh 

305.000 

264.000 

246.000 

.000 

.000 

.000 

hINInUH 

204.000 

193.000 

217.000 

.000 

.000 

.000 

0 A L L G R G U P 8 

COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


0 

OMEAN 234.540 


3. DEV. 14.705 

N 176. 

MAXIMUM 305.000 

HINi'rtUM 1^3.000 

SUi'-i OF SQUARES 
EITWEEN 2936.8435 
WITHIN 34902. 62S9 
TOTAL 37839.4686 


DF MEAN SQUARE F RATIO PROS. F EXCEEDED 
2 1468.4216 7.2784 .0009 

173 201.7493 

175 
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o o 


.i T-:faiLr-.TTQN OF TABLE! 


4 HM.Yr.G 


HUDPl HUD2 HUD3 

MIDPOINTS 

165.000) 

150.000) 

135.000) 

120 . 000 ) * 

105.000) 

90.000)* 

75 . 000 ) 

60.000) 

45.000) * * 

30.000) ***** 

15 . 000 )** * * * * * * * * * * * * 

. 000 )***** n ******>;-36 I ' i * *** ***<^3 

-15. ooo)M*******i7 ********12 ****•>;*.*** 

— 30 .000 )** ****■*'!' ** ** + ;!'••« * 

-45.000)******** 

-fcO.OO-O)** 

- 75 . 000 )** * 

— -go. 600) 

-I. os. 000 >* 

-120,000) 

-135.000) 

-I so. 000 ) 


0::0UP MEANS 

ARE DENO 

TED DY M'S 

IF THEY COINCIDE 

WITH 


N'S 1 

DTHERUTSE 

MEAN 

-13.465 

-3.845 

-3.283 

.000 


.000 

. 000 

S. DEV. 

37.094 

12.233 

1 1 . 756 

.000 


.000 

. 000 

N 

58.000 

58.000 

60.000 

.000 


.000 

.000 

MAXIMUM 

126.000 

46.000 

21.000 

,000 


.000 

.000 

MINIMUM 

111. 000 

-33.000 

-71.000 

.000 


.000 

.000 

OALL GROUPS 

COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR 

eithe; 

R VARIABLE) 


OHFAN -6.824 

S. DEO. 23.77S 

N 176. 

MAXI HUM 126.000 

MINIMUM -111,000 

SUM OF SQUARES 
BETWEEN 3825.2986 
WITHIW 95115.1875 
TOTAL 98940.4375 


DF MEAN SQUARE F RATIO PROB . F EXCF.nDEI.' 
2 1912.6492 3.4788 .0330 

173 549.7986 

175 
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rABULATION OF VARIABLE 


2 MHvaVR 


HUIiPl HUD2 

-f 

HIDPOINTS 

24.000) 

22*. 500) 

21 . 000 ) # 

19.500) 

13.000) 

16.500) 

15.000) 

13.500) 

12 . 000 ) * 

10.500) *# 

9.000) ##*# # 

7.500) #*#* **### 

A, 000)#*##**### *#***# 

4 .500) H******* #*#<;*###** 

3 . 000 ) *#****#*. M##****** 

1 .500) ###*****12 *##*;i::l#’!' 1 4 
. 000 ) ##***# ###■#*'{: 

-1.500)** #** 

-3.000)# *#* 

-4.500)# 

-ft.0(>0) 

i 500 ) 

GROUP MEANS ARE DENOTED BY M'S 


HUD3 

+ . , 


#****# 

*###*#* 

#>»**.*#*# 

;4 * 1 4 
*#*#A**#t4 

1 .V --fr i 
** 

#* 


IF THEY COINCIDE WITH M'Sf 


+ 


N'3 OTHERWISE 


MEAN 

3.895 

3 . 050 

2*897 

.000 

.000 

.000 

S. DEV, 

4,104 

3.215 

2*618 

.000 

.000 

.000 

N 

53.000 

58 . 000 

60 * 000 

.000 

.000 

* 000 

MAXIMUM 

21.500 

12 . 400 

8 ♦ 100 

. 000 

.000 

.000 

MINIMUM 

-5.200 

-3.500 

-3 ♦ 300 

.000 

. 000 

.OOO 

OALL GROUPS 

COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


0 


OMEAN 

3.276 


S. DfcV. 

3.370 


N 

176. 


MAXIMUM 

21.500 


MINIMUM 

-5.200 


SUM OF SQUARES 

DF 

BETWEEN 

33.3071 

'y 

WITHIN 

1953 ..8967 

173 

TOTAL 

1987.7036 

175 


MEAN SQUARE F RATIO PROB. F EXCEEDED 
16. ,9035 1,4967 .,2268 

11.2942 
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3 MMHBOT 


■'jvLATIO ? 0!^' vARILABlE 


HiJDPl 


<4*500> 

3 . 0 d 0 f 

1 .SOOh* 


HUD 2 

4 " ♦ * ♦ • 


HUD 3 

♦ + 


+ ♦ + 


. ooo > 

-trSOOXM)! 
•i.ooo icitn 
- 4 .SdO « 



♦ 




• 7 . 90 O)****Xf 

♦*** 




• 9 >006 HZ*** 


%%% 



-to. soot******* 

: 4 c :< c ^}| X 4 c 4 :*l 1 

*#♦##***19 



^tz. ooom ***** 

M #*#*** i (13 

M ***#**#16 



-t 3 .S 00 *ttt 


********11 



HS.OOO’ ****** 


*****.**** 



- 16.500 ***** 
-t 9.000 ****** 
• I 9 . 500 :x 

}:■■%%% 

%%% 

*:> 



• V . OOO 

%■ 




-ZZ . ZOO ■ 
- 24.000 
• 25 . 500 ' 
- 27.000 X 

% 




<»OUP NEi ^ 4 RE DIINOTED BY M'S 

IF THEY COINCIDE 

WITH t'Sf N'S OTHERWISE 

-11 *252 

- 12*122 

- 12,232 

♦000 .000 

♦ OOO 

Si br . V » 5 #450 

3*320 

1.825 

♦000 .000 

*000 

58*000 

58 ♦ 000 

60.000 

♦000 ♦OOO 

*000 

! 1 :^ X 1 HUH 1 ♦ 900 

- o *500 

- 9.100 

. OOO ♦ OOO 

*000 

O - 2/ *100 

- 22*100 

- 17.100 

,000 .000 

♦ OOO 

ALL . GROUPS combined 

< CASES EXCLUDED IF SPECIAL 

CODES FOR EITHER 

OARJABLE ) 


u 

OrtEAN 


K AX I HUH 
HINIMIIM 


- 1 . 1 .873 
3 . 821 
176 . 
1,900 


- 27.100 



SUM OF SQUARES 

DF 

BETWEEN 

33.7137 

2 

w:l thin 

2521.4824 

173 

“f U r AL 

2555.1960 

175 


MEAN SQUARE F RATIO PROP . F EXCEEDED 
16*8568 1*1566 *3170 

14*5750 
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iTA*vir ATTn^i ne- riA-. — 

• i I xwtl Wl VMr\X«Oi-C. 


HUDPl HUH2 HUti3 

+ + 4 

MITiPOINTS 

252.000) 

245 . 000 ) 

236.000) 


2"ii ,000)* 

224.000) 

217.000) 

210.000) 



203 , 000 ) 



196.000)**** 

:4c 

* 

139,000)** 

t 


182,000)**** 

AM 


175.000)*** 

^ 

M 

168.000 )»*•***** 



161 . 00 0 ) H* i * * ***12 



154 ,000)********* 


hMMAM MMM20 

147. OO'O ) ****** 



140.000)******* 



: 33.000)* 




) 2 (Tv, 000)** * 

119.000) * 
i 3. 2. 000) 

105.000) 

GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH *'S? N'S OTHERWISE 


MEAN 

161.862 

158.086 

149.6 

.000 

,000 

« 000 

S. DEV. 

19.976 

IB. 816 

7.S 

.000 

,000 

sOOO 

N 

58.000 

58.000 

58.000 

♦ 000 

sOOO 

%000 

MAXIMUM 

232.000 

234.000 

175.000 

♦ 000 

.000 

.000 

MINIMUM 

123.000 

120 . 000 

129.000 

* 000 

.000 

.000 


OALL GROUPS COMBINED (CASES EXCLUDED IF SPECIAL CODES FOR EITHER UAF-:IABLE) 
0 

OMEAN 156,750 

S» DEV, 17,268 

N 176, 

MAXIMUM 234,000 

MINIMUM 120,000 



SUM OF SOUARES 

DF 

MEAN SQUARE F RATIO 

PROB. F EXCEEDED 

BETWEEN 

3950.5371 

2 

1975.2686 7.0852 

. 001 1 

WITHIN 

48230.2969 

173 

278.7878 


TOTAL 

52180.8320 

175 




106 



3. TABULATION OF VARIABLE 


2 IMYC6 


HUDPl 


HUD2 


HUD3 


MIDPOINTS 

120 . 000 ) 

10 - 3 . 000 ) 

90.000) 

7-0. 000) 

60.000) ** 

43 . 000 ) 4 
30. 000 )****«: 

15. 000) *** 

. 000 ) *****-*:*** 

-1-S.000)M**4****16 **4^*4 + 

“30 . 000 > * **;M2 **•> 
-4S.000>**** * 

-60.(300)*** 

-73.000)** 


* 

** » 

****:4:** ♦ ♦* *4 ***** 
M****:4..t*? 1 M* * *!{ **v44 

**** * 
i 


- ! 03 . 000 ) 
j.?0.(300> 

- 153 . 000 ) 

-150.000) 

-165.000) 

-IBO.OOO) 

-195.000) 

GROUP MEANS ARE DENOrED BY 


NS IF THEY COINCIDF WITH *'Sy N'S OTHEKWISc 


MEAN 

-15.328 

-3.690 

.43 

.000 

.000 

. 000 

S. DEV. 

31.055 

14.173 

9.6 

. 000 

. 000 

. 000 

N 

50.000 

58 . 000 

58.000 

. 000 

. 000 

.000 

MAXIMUM 

64.000 

34 . 000 

38.000 

.000 

.000 

.000 

MINIMUM 

-89.000 

-44.000 

-25.000 

. 000 

.000 

. 000 

OALL GROUPS 

COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES FOR 

EITHER 

VARIABLE) 


0 

OMEAN 
S. IiEV. 
N 

MAXIMU.M 

MINIMUM 


—6 . 943 
23.711 
176. 
64.000 
-144.000 



SUM OF SQUARES 

DF 

BETWEEN 

6167.2461 

2 

WITHIN 

92215.8125 

173 

TOTAL 

98383.0000 

175 


MEAN SOUARE 
3083.6230 
533.0393 


F RATIO FROB. F EXCEEDED 
5.7850 .0037 
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ITABULATION OF VARIABLE 


3 IMVQVR 


HUDFl 


HUD2 


HUD3 


MIDPOIHTS 

24.000) 

22 . 500 > 

2 1 , 000 > * 

19.500) 

16.000) 

16.500) 

15.000) 

13.500) 

12.000) 

10.500> 

9 - 000 ) *♦ 

7.500)#**^’)* 

6. 000 

4. 500 

3.000; i J 

1 - '500 ‘ T * i- 1 i. 

. 00 (' ) 

-1.500)** 

-3.000)#** 

-A : 500) 

-6 I 000 > * 

-7.500' 


♦ * 

* 

** 

*** 

*• ^.4.;y V ,{• i 2 

* •) *■; ; * X jn Ji- . 

***4.f.,')* 

#** 

*#* 

** 


** 

** 

**•«•■»•“ '•**1 1 
* . i 3 

** 


** 


GROUP MEANS ARE DENOTEB 

BY M'S 

IF THEY COINCIDE WITH 

N'S □'iH£KUiS£ 

MEAN 

3 »3lO 

2.96B 

2 . 302 

. 000 

*000 *000 

S. DEV. 

3*930 

3.771 

3.062 

. 00 O' 

*000 *000 

I'l 

58 < 000 

58.000 

6(' . 000 

,000 

♦000 *000 

MAXIMUM 

20 * 600 

12.300 

9.600 

. 000 

• 000 * 000 

MINIMUM 

-5*300 

-4.900 

-6.700 

. 000 

*000 *000 

OALL GROUPS 
0 

COMBINED (CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER OhRIhSLE) 

OMEAN 

2.860 





S. DEV. 

3.624 





N 

176. 





MAXIMUM 

20*600 





MINIMUM 

-6*700 





SUM 

OF SQUARES 

DF 

MEAN SQUARE F RATIO 

PROB* F EXCEEDED 

BETWEEN 

31 .4165 

2 

15.7082 1. 

1989 

♦ 30^40 

WITHIN 2266.6057 

173 

13.1018 




■OTAL 


2298*0220 


17! 
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4 IMHHOT 


iDU^fS ? IQ|\ OF VhR 


ABLE 


HUDFl KUD2 

mOPOlNTS 

^*000 


HUD3 

+ + 


7.SOO 

6.000> 

4*500) 

7 . 000 ■ 

1 . 500) 

.OOO 

-t.SOO) 

•3.000 

-4.SOO.’«« 

•4.000)* 

•7.500>***<* 

•9.000 

• 1 0. soo ' n»****s*:n 
•I 2* ooo M«*jrt**x 
•13.500 ***<*«» 
-15.000 ' *«X***I(* 
•I 4. soo;** 
•18.000 '«X 
•19.500* 

•2I..OOO) 


* 


t 


* 

* 

;{i :){ '>N ;<{ ;f; :{; ;r. .t '4: k .f .a » .♦•' :» 1 3 

M if: .f: ;f: * ;+■ .f; :{; J 5 m ;f •': /{; .f; .'• .> .■> j ^ 

-« ;f. ♦:***•* :+L K * * * if. .;•. >s. * * 1 4 

.ft If- )f: if. if..* **f: '•*».>}'* 

m 


•K 


+ 


+ 


•22 . 500 1 


S80VP rffiANS AKC OENOTEO 

BY M'S 

IF THEY COINCIDE WITH 

*.'St N'S OTHERUilSE 

MEAM 

-11.271 

11.348 

-11.427 

♦ 000 

.000 .000 

S. 0£V. 

3* 680 

3 » 4S 1 

3.771 

*000 

,000 ,000 

N 

58*000 

58.000 

60.000 

*000 

.000 .000 


-2 ♦ 60‘J 

-3.200 

7.800 

♦ 000 

.000 .000 

MINI nuri 

-^9.500 

21.400 

-15.700 

* 000 

.000 .000 

AU. 6A0UPS CGriBINCri (CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER OARIABLE) 

0»’i£HW 

-11*349 






3*630 





N 

\ 76 * 





MAX THU h 

7*800 





TXIHLIH 

-21*400 





CM 

JH OF SQUARES 

DF 

MEAN SQUARE F 

RATIO 

PROB. F EXCEEDtii 

i-:" rwELEi'i 

*7176 


. 358S 

*0269 

< 9734 


2305 * 7073 

173 

13.3278 



TOTAL 

2306*4246 

175 
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Nonprecision Flights 

Just as in the precision case, we give a list of significance 
levels of the nine variables under study. The first three vari- 
ables (OMHDOT, MMALT, and MMYCG) are then reana- 
lyzed with one flight (041209) deleted. There are two good 
reasons for doing this. In the first place, the extremely high 
value of MMALT for this flight and the absence of data for 
MMQVQR through IMHDOT suggest this flight is unrepre- 
sentative and should be omitted. In the second place, it is 
very important and reassuring to see that it is a fact that the 
omission, even in this extreme case, makes relatively small 
impact on the significance levels and means in the tables 
of analysis. 


The order of the tables which follow corresponds to the 
list of significances below. 


Variable 

Significance Level 

OMHDOT 

0.7900 

MMALT 

.0365* 

MMYCG 

.1928 

MMVQVR 

.5150 

MMHDOT 

.7183 

IMALT 

.0016** 

IMYCG 

.0282* 

IMVQVR 

.3584 

IMHDOT 

.3095 

OMHDOT (041209 deleted) 

.8149 

MMALT (041209 deleted) 

.0014* 

MMYCG (041209 deleted) 

.1864 
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nftBa.ATION Or VARIABLE 


2 OMHDOT 


HUDNJ. HUD2 HUD3 


n 


DFOTi-.'TS 
33 . 0<>0 ) 


+ 


+ 


+ 


30.000) 

27 . 000 ) 

24 . 000 > 

21 . 000 ) 
ta.ooo) 

15.000 V 
12. 000) 

9. 000 >*«:+■** 

6 * 000> 

3, 000 ) V 

, 000 ) *.13 

— S.OOO ) 

- 9 . 000 )*■:{< 

•12 

• I S » 000 > * t. :i •' 

18.000) Hi. 

21 .000 V 

>24. 000 .V 

27.000) * 

30,000.> 


« 


* 

** 

*♦***{*».# 

4 c*c*c)K*( 3((4 c 4 l*;* 

•***;;<**:i< 

* 


y.E,i^a ftfvR DENOTEIi BY M'S 


* 


*»##*#**24 

M#******12 


♦ 

* 


Ir THEY COINCILiE WITH *:'S» 


MFAK 

-2,749 

-1.922 

-2,790 


5* i:n:vv 

8 .70S 

8.444 

5.985 


N 

59,000 

60.000 

60.000 


HAXI»''»Uh 

13,900 

25.900 

10.800 


hi ntmlm 

-27.600 

-19,000 

-19.800 


RRr?: 

iPS COnPINEn (CASES EXCLUDED 


u 

OMEAK 

-2.485 




S* DEV. 

7.769 




N 

179. 




H AX I MUM 

25.900 




nIMIhUH 

-27,600 




SUH or SQUARES 

DF 

MEAN SQUARE 

F RATIO 

BETWEEM 

2S.7387 

2 

14.3694 

.2360 

WITHIN 

10714.6523 

176 

60.8787 


TOTAL 

10743.3906 

178 




PROB. 


'S OTHERWISE 


F E.XCEEDErt 
.7900 
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1 TABULATION OF VARIABLE 


3 MHALT 


HUDNl HUP2 HUBS 

-I- -f 4 4. . » * 4 

MIDPOINTS 

2000,000) 

1900.000) * 

1800.000) 

1700.000) 

1100.000) 

1500.000) 

1 -100. 000) 

1300.000) 

1200.000) 

1100,000) 

iCOC.OOO) 

900.000) 

GOO, 000) * 

700.000) 

AOO.OOO) 

500.000) *-t 

4»00 . 000 >******** 1 1 *4** 

300;000)M**.i4***^l n*4:t***432 

200 .000) **44 A L**;! .t:***.!}.*:! 41 1 ***»**.4434 

100 . 000 ) # 

, 000 ) ♦* 

- 100 . 000 ) 

GROUP MEANS ARE DEMOTED BY M’S IF THEY COINCIDE WITH *'Sf N'S OTHERHISE 


MEAN 

316,708 

303.964 

253.499 

• 000 

• 000 

.000 

S. DEV. 

211.383 

112,041 

50.223 

• 000 

• 000 

,000 

N 

59.000 

60.000 

60.000 

• 000 

.000 

.000 

MAXIMUM 

1866.000 

335.000 

436.000 

♦ 000 

.000 

,000 

MINIMUM 

184.000 

25.000 

175.000 

• 000 

• 000 

.000 

CALL GROUPS 

COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES FOR 

EITHER 

UARIADl.E) 


0 

OMEAN 291.249 

S, DEV. 142,500 

N 179, 

MAXIMUM 1866.000 

MINIMUM 25.000 



SUM OF SQUARES 

DF 

MEAN SQUARE F RATIO 

PROB. F EXCEEDED 

BETUEEN 

133443.3125 


66721.6250 3.3734 

.0365 

WITHIN 

3481059.0000 

176 

19778.7422 


TOTAL 

3614502,0000 

178 
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T.:-.EuLATION of VAR table 


4 MMYCG 


HUDNJ. HUD2 HUD3 

♦ + ....♦♦♦.♦.+ 

i>5Ii;iPOINTS 

300.000) 

280 » 000 > 

260.000) * 

2i^0»<'00'‘ 

220 . 000 > 

200 , 000 > 

I80.000' ** 

140.000)* * 


• coo > 

** 









loo# 000 ;• 

*** 




dO»000)*¥ 

** 




AO • O CO- > 

*** 

#** 



40. 000 i **'**»■.**** 

*** 




20* 000 > .1 


;i 



• OOO/ ^ 'i 

******** 




# 0 OO V. *tv V -K >i-. 

>|v 

********* 



-<qO. 


*** 



• 40 , 0 ^ 0 / ****** 


** 



- 80 * dCO ’ V f r + 


x> 

•T. 



-lao. ^o> 





-jaso.ooo'.'*** 






OTED BY M'S 

IF THEY COINCIDE 

WITH 

*'S» N'S OTHERWISE 

f i i. -'i i\ “* 9 • H 

10.333 

4 #700 

.000 

.000 .000 

i;. nev# 54,727 

80.371 

34#282 

.000 

.000 .000 

W 59*000 

60,000 

60*000 

.000 

.000 .000 

1.64, 000 

268,000 

136 ♦ 000 

.000 

.000 .000 

-i i.4*ooo 

-125.000 

-74-000 

♦ 000 

♦000 .000 

CAi.L Gr:n:jPS COMBINED 

r. 

(CASES EXCLUIiED IF SPECIAL 

CODES 

FOR EITHER VARIABLE) 

'J 

OMEaN 2# 

061 




B * DEM * 59 ♦ 

773 




N 179* 





i Ml.hX 26f3 * 

000 




MlfyMMUM -125* 

000 




SUM Oh SQUARES DF 

MEAN SQUARE F RATIO 

PROB, F EXCEEDED 

BETUEEK 1.1786.3009 

r> 

AlW 

5893.1484 1. 

6617 

♦ 1928 

U'' TKIM 624164 ,3125 

176 

3546,3879 



TOTAL 635950,5625 

178 
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TABULATION OF VARIABLE 


2 MhVaVK* 


HUDNl 

HUD2 

•f 

HUDo 
+ 

MIDPOINTS 

22.500) 
21.000) 

19.500) 
13.000) 


* 

16.500) 
15.000) 

13.500) * 



12,000)** 

* 

* 

10.500) 

*** 

** 

9.000)**** 

**** 

**** 

7, 500 )*****♦***♦ 

********* 

******* 

6.000)#*’**** 

******** 

***** 

4.500)H**#**#* 

ii******#12 

M****** 

3.000)***** 

******* 

**:*#***: 

1.500 )•*»***# 

** * * *#* 

*1} *****. 

.000)**#*;!:* 

***** 

***** 

-1.500)***# 

** 

*Jt 

-3.000)*** 


* 

-4 , 500 ) * 

* 


-6.000)** 


# 


+ 


+ 


-7.500) 
- 9 . 000 ) 


GROUP MEAN 

3 ARE DENOTED BY M'S 

IF THEY COINCIDE 

WITH 

#'Sj N'S otheruise 

MEAN 

3.784 

4.629 

4,335 

.000 

.000 

.000 

S. DEV, 

4.381 

3.352 

4.235 

.000 

.000 

.000 

N 

58,000 

59.000 

60.000 

.000 

.000 

.000 

MAXIMUM 

13.200 

11.300 

17.700 

.000 

.000 

.000 

MINIMUM 

-5 . 900 

-3.800 

-6 . 300 

.000 

.000 

, 000 

ALL GROUPS 

COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


0 

OMEAN 
S. DEV. 
N 

MAXIi-iUH 

MINIHUH 


4.253 

4,007 

177, 

17 . 700 
-6,300 



SUM OF SQUARES 

DF 

MEAN SQUARE 

BETWEEN 

21.4677 


10.733? 

WITHIN 

2803^9753 

174 

16.1148 

TOTAL 

2825.^4429 

176 



F RATIO 
.6661 


PROB, F EXCEEDED 
.5150 
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llfttfULATION OF VARIABLE 3 MHHBOT 


HUDNl 


MIBPOINTS 

44.000) 

40.000) 

36.000) 

32.000) 

29.000) 

24.000) 

20 . 000 ) 
16.000) 
12 . 000 ) 

8 . 000 ) 

4.000) 

. 000 )« 

-4.000)*1f»» 


HUD 2 

♦ 


lioi' 


* 


t 


HUD 3 

^ » « . . 


» 


+ 


-e. 000 12 

- 1 2 . 0 0 0 ) M # * *• .t # X : 1 3 H -t * * A » ♦ :t. i 7 
-16.*000)#*f****:r20 ?3 6 

- 20 . 000 ) 1 1 

-24.000)*** *** 

-28.000) 

-32.000)* 

—36 . 000 ) 

-40.000) 


#)(!**** 
«**4C****39 
lif t *»♦**»** 

* 


+ 


GROUP MEANS ARE DENOTED BV M'S IF THEY COINCIDE WITH *'Sf 


+ 


N'S OTHERWISE 


MEAN 

-13.224 -12.195 

-12,420 

.000 

.000 

.000 

S. DEV. 

5.417 

10.471 

4.004 

,000 

.000 

.000 

N 

53.000 

59.000 

60.000 

.000 

.000 

.000 

MAXIMUM 

-.800 

33,900 

5,200 

. 000 

.000 

.000 

MINIMUM 

-30.900 

•25,000 

-22,100 

.000 

.000 

.000 

CALL GROUPS COMBINED (CASES EXCLUDED IF SPECIAL CODES 

A 

FOR EITHER 

VARIABLE) 

V 

OMEAN 

-12.608 






S. DEV, 

7.156 






N 

177. 






MAXIMUM 

33 . 900 






MINIMUM 

-30,900 






SUM OF SQUARES 

Uh 

MEAN SQUARE 

F RATIO 

PROB. F EXCEEDED 

BETWEEN 

34.2149 

2 

17.1075 

.3316 

,7183 


WITHIN 

8977.9414 

174 

51.5974 




TOTAL 

9012.1563 

176 
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IIABULATION OF VARIABLE 


4 IMALT 


HUDN1 HUD2 HUD3 

+ , ^ + + 


MIDPOINTS 

880,000) 

840.000) 

800.000) 

760.000) 

720.000) 

680.000) 

640.000) 

600.000) 

560.000) 

520.000) 

480.000) 

440.000) 

400.000) 

360.000) * 

320 . 000 ) 

280 . 000 ) *** 

240. 000) »»t*:f**1c 

200 . 000 ) H*:;:*****25 

1 ,** 0 , y V 0 i ** * * .’il* * * X o 


« 


* 

« 

* 


***** 

HtSI**.*** #X-:i 

****»*.»*23 ****** *#12 
***'*’'** -V' * 'L j **#*29 


120,000)** ** ****.***.*14 

80.000)* 

40.000) 

GROUP MEANS ARE DENOTED BY M'S IF THEY COINCIDE WITH *'Sf N'S OTHERWISE 


MEAN 

195,758 

220.712 

172,716 

,000 

.000 

.000 

S. DEV. 

42.810 

99.611 

60,598 

.000 

,000 

,000 

N 

58,000 

59 , 000 

60.000 

,000 

.000 

.000 

MAXIMUM 

356.000 

804.000 

468,000 

,000 

,000 

,000 

MINIMUM 

92.000 

128,000 

106.000 

,000 

.000 

,000 

OALL GROUPS 

COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABLE) 


OMEAN 

196,265 




S, DEV, 

74.053 




N 

177. 




MAXIMUM 

804,000 




MINIMUM 

92,000 





SUM OF SQUARbS 

DF 

MEAN SQUARE F RATIO 

PROB. F EXCEEDED 

BETWEEN 

68547 , 5625 

'7 

34273,7813 6.6513 

,0016 

WITHIN 

896609,3125 

174 

5152,9258 


TOTAL 

965156,8750 

176 




4 
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OF FT A RLE 


2 IHYCi:^ 


Hu II Ml 


HUD2 


HUD3 


NlfiPOlNTS 
420^000 • 

3tO.OOO < 

3«O.000 • 

330.000) 

300.000 

270.000) 

240.000; 

210 . 000 ' 

190,000> 

1 50 . 000 ; 

120 . 000 ) 

90.0C0,'»]C 
6O,00O))itXJtX 
30.000 xtxxxrx 
.000 HUPtXXXX* 17 
- 30.000 :t*txrJt*yn7 
•60 . 000 'tf«tirx«43kx 
-90.000 X 
-120.000 Mr 
-150.000 . 

-180. 000 

- 210 . 000 ' 

GROUP MEAMS ARE i’lENGTED BY 


* 


* 

■V 

i 1 

ft 

♦ 


M- 


**i*****1.1 


IF THEY COINCIDE WITH W-'Sf N''S O'lHERWISE 


hLAN 

-8*Q4S 

14*390 

4.717 

.000 

.000 .000 

B* DEV.^ 

41 ♦812 

65 ♦ 641 

22,789 

.000 

.000 .000 

iN 

S8p000 

59*000 

60 , 000 

.000 

.000 ,000 

•” 1 1 ••• T h f ‘ 

RA.OOO 

296*000 

73 . 000 

. 000 

.000 ,000 

r'll N .1 rU'^! 

-107*000 

106*000 

-39.000 

.000 

.000 .000 

:-iL:. ORuUHS COMBINED (CASES EXCLUDED IF SPECIAL 

CODES 

FOR ETTHFR UAftTABI P) 

►K.EAH 

3.497 





3 - DEv 

47.441. 





w 

1.77. 






29A.000 





rtiNIHUh 

-107,000 






SUM OF SQUARES 

DF 

MEAN SQUARE F 

RATIO 

PROB. F EXCEEDED 

iF.TWEEN 

15924.2500 

2 

7962.1250 3 

.6439 

.0282 

ilTHIN 

380195.4375 

174 

2185.0313 



"OTAL 

396119.6875 

176 
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3 IMVOyR 


; wrl/i-AT !i O'-! iji 


HULiWl HUD2 HUD3 


HIDPOINTS 


21 ,oeo> 

19.500) 

I S. 000 ) 4' 

16.500 

I 5.000 > 


is.foorjr 
12.000) 
io.50o>;t;rjr 
9.000)*«k)M 
7*SeO>t:bfM*t)U 
6.000: rxmjr 

4 . 

^*000 *Jft**X*Mli 

j,5oo>3mj»*t 


* 

* 

** 

Jjt*****^ * 

H******* 

**** 
ii;**f***!i!*] 1 


-1.500 M * 

-3.000 jr Ai 

-4.500> 

- 6 . 000 / * 

-7.500 
-9.000 0 
-JO, 500 


"■•ri-'Jp hSClAi-ir are denoted BY M'S 


* 


ttt 

*)K* 

*** 

*)f; 

* 


IF THEY COINCIDE WITH 


*'Sf 


+ 


N'S OTHERWISE 


MEAN 

4.347 

4.663 

3.615 

.000 

.000 

.000 

R* DEV. 

3.978 

4.053 

4.210 

.000 

.000 

.000 

M 

58 » 000 

59.000 

60.000 

. 000 

.000 

♦ 000 

nAX li-iUh 

i;:w900 

17.800 

16.400 

.000 

.000 

.000 

ril;4inUH 

— T . . 5 00 

-5.800 

-4.900 

.000 

.000 

.000 

CALL GRGUP3 

COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES FOR 

EITHER 

VARIABLE) 


0 

OMEaN 
. D £ V* ♦ 
N 

h -XT MOM 
MINIMUM 


4 . 204 
4.084 
177, 
i'-’ . 800 
-9.300 



SUM OF SQUARES 

DF 

between 

34.4086 

2 

WITHIN 

2900.5803 

174 

TOTAL 

2934.9888 

176 


MEAN SQUARE F RATIO 
17.2043 1.0321 

1^ . 6700 


PROB. F EXCEEDED 
.3584 
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1 TABULATION OF VARIABLE 


4 INHDQT 


HUDNi 


• « * * » 4 4. 


Huri: 


MIBP 
30 
27 
2- 
2 j 
IS 
15 
1 2 
9 
6 


DINTS 
♦ 000 > 
4 000) 
.. 000 > 
4 000 ) 
t 000 ) 
♦ 000 ) 
^000 
. 000 > 
♦ 000 ) 
♦ 000 ) 
4 000 > 
000 ) 
4 000 ) 


♦ ♦ • + . 


HUD3 




♦ ♦ ♦ ♦ 4* I 


* t 




* 


% 

% 


“ J 2 4 000 '# 1 4 K.’Kit * t f 4 

- 1 . S - *>00 :• ri tZ 
-18*000 >4: 12 

-2 t 4 000 .) i'C :r * >;< 

“?4 • 0<)0 > 4 ; 

-*27 • 000 • 4 
-3D* ':'00 ) 

-33 * 000 > 


He 

-t. *. -ic )fc 4^ >1^ 4 : ■>. -t Y. ic A< 

>r 4 ■*■• 4 i». + . 7 : > 4- A * -*C ;»<. 4 4 i >;.• >ic 

+ * 

)K 

>:4 

HIM 


GROUP NEANS ARE DEi4DTED BV h'S 


IF THEY COINCIDE WITH N'S OTHERWibE 


MEAN 
S* DEO* 

N 

MAXIMUM 
MINIMUM 
CALL GROUPS 
0 


-14.853 

-13.034 

-12*933 

.000 

.000 

♦ 000 

5 • 6 S4 

10*061 

6*325 

.000 

.000 

4 OAO 

5B * 000 

39 , 000 

60 ♦ 000 

. 000 

. 000 

• 000 

10 4 800 

25 . 900 

19*500 

. 000 

. 000 

4 0 0 0 

-26*900 

-29 . 600 

-23*200 

,000 

.000 

♦ 000 

COMBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

UARIABI F > 


OHEAN 
S < riEV . 
N 

MAXIMUM 

MINIMUM 


-13.396 

7.616 

177. 

25.900 

-29,600 



SUM OP SQUARES 

DF 

MEAN SQUARE F RATIO 

PROS. F EXCEEDED 

BETWEEN 

136.6967 


68.3484 1.1806 

.3095 

WITHIN 

10072. V570 

174 

57.&905 

• 

TOiAL 

10209.6523 

176 
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iTAPuLATIPN OF OAF'IABLE 


2 OMHDOT 


HUDNl HUD2 HUH3 

vjTripnTVTc 

?3.oboJ 


30 . 000 > 

27.000 * 

24.000) 

2l.0<50 = 

18.000 * 

tZ.bCOiHe 


i2,ooo: * * 

9. 000) 4*S>"4C:K *» 

A . 000 * i 'Krf *>!c 

»©00 )*4:**tx -: T13 **#**5ic:{c:»:** 

-3.000 M'«*****!»tl2 
-4.000) #»#*#*♦• 

-9.000) »««« «« 

-12.000.-8«X 

-1.5 . OOO) »X«}t;^ :*■ Si * 

-(5«000-8< SofcS-ScS^ Sc%- 

-2l.ooo:jf * 


-24.000 ’ 

-27.000)* 

• 30*000 :> 

cmoijp nSANS 8K£ LiENOTED by M'S if they coincide with *'Sf N"S OTHERWISE 


ni;;. AN 

-2,598 

-1.922 

-2.790 

♦ 000 

.000 

,000 

S - OEiV * 

8,702 

8.444 

5.985 

,000 

.000 

,000 

M 

58.000 

60,000 

60.000 

.000 

.000 

.000 

HAXIHUH 

1 3 , 900 

25.900 

10.800 

,000 

.000 

.000 

H xNIriiiri 

—27 , 600 

-19,000 

-19.800 

.000 

,000 

.000 


C' .LL GRri.iFF. COtiPIHi:.r' (CASES EXCLUDED IF SPECIAL CODES FOR EITHER OARIABLE) 


0 

OMEAN 

S. DEV. 
N 

MAX THUH 


-2,435 

7.761 

178, 


25 . 900 
-27,600 



SUM OF SQUARES 

DF 

Bf; ruEEw 

24,9182 

2 

WITHIN 

10636.7578 

175 

TOTAI. 

10661.6758 

177 


HEAN SQUARE F RATIO 
12.4591 .2050 

60.7815 


PROB. F EXCEEDED 
♦ 8149 
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3 MMALT 


^•.j;..ATION 0!- VARIABLE 


HUruMl HUD2 HUD3 

+ ♦♦ + + 

rilDPG INTB 


1.000.000) 

950.000) 

900.000) 
850. <;•<•<■■ • 



800 . 000 
7SO.OQO.> 
700 . 000 ) 

650.000) 
600. 000 ) 

550.000) 
500.000.) 

450.000) 


$ 

400 .000) >■ -i. 4- :-i • 



3S0. 000 ) 1 


*3«C* 

300 . 000 )• y, . 4 ' %■ ;? 1 1 A 

w .1. :« .1 .1 u. J. «- •— s* 
n M 4S ^ ^ ^ ^ w 


ISO . 0 0 0 ) ij; .4: * .+: M 2 0 


M**-*:JK:4wf'5K2G 

200 • 000 >)f- 



f So. 000 . 


* 

lOO.OOO' 

so. 000 '• 

i*C)K 



.000 * 

*S^«COO • 

6KOUP MEANS are WE'^OTED BY M"S IF THEY COINCIDE WITH N'S OTHERWISE 


!•:;• AN 

2S9.997 

30"3 . 964 

253.499 

♦ 000 

,000 

.000 

DEU. 

51.290 

112.041 

50.223 

.000 

.000 

.000 

N 

58 . 000 

60.000 

60.000 

.000 

,000 

.000 

-’Ay I HUM 

•403.000 

835.000 

436.000 

,000 

.000 

.000 

H r ! I Hf 

1 9<> * 000 

25.000 

175.000 

.000 

.000 

.000 

: :.„L. l:»RUL«P."* 

CGHBINEr 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

OAK TABLE) 


OMEAN 282^402 

5* DEW* 79.574 

N 1“‘S. 

835.000 

nlN ! HUH 25.000 


SUil OF SQUARES 

DF 

MEAN SQUARE F RATIO 

PROS. F EXCEEDED 

BETWEEN 81.362.0625 

2 

40681.0313 6.8493 

.0014 

W.rTHIN 1039410.1250 

175 

5939.4844 


TOTAL 1120772.0000 

177 
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i 7Hi:Ul.,ATieW OF VARIABLE 


4 HMYCG 


HUI'Wl HUD2 HUD3 


H I UPC I NT o 

300.000) 

250.000) 

260.000) 
240 . 000 ) 
220 . 000 / 

200. OOQ > 
180.000; 
140.000'/^ 

1^0. OOO) 

izo.ooo) 

1 00.000/* 

80.000)** 

40. 000 

40. 00O> ;»;**+• 

20.000 

-20.000 ; 
—40.000) 
-40.000: ***>?*-t 
-80.000' 
-lob.ooo) 

-120.000'' *:K* 


% 


%% 

t 

♦*. 

*** 

M*;***#**12 

***** 

**** 

**** 

**** 

**** 

** 


G*00P MEAMS ARH ULNOTED BY M'S 


* 

* 

* 

*** 

***** 

**** 

M*******3'0 

********* 

*** 

** 

* 


IF THEY COINCIDE WITH *'Sf N'S OTHERWISE 


fiEAiv 

-9.362 

10.333 

4.700 

.000 

.000 

. 'OO'O 

S. DEV* 

55 * 146 

80.371 

34.282 

.000 

.000 

.000 

r» 

58 f 000 

60.000 

60.000 

.000 

.000 

.000 

H. IKUh 

:l.6^.000 

268.000 

136.000 

.000 

.000 

.000 

•n. MTHUrt 

-i j ^ ,000 

-125.000 

-74.000 

.000 

.000 

. 000 

ALL GkCUJ 

IPS COHBINED 

(CASES EXCLUDED IF SPECIAL 

CODES 

FOR EITHER 

VARIABl F> 


•r'MrAN 
S. DEC 
H 


2.017 

59.938 

178. 


MiiXlNLlN 


263.000 


MINIMI i:'i 


-125.000 



SUM OF SQUARES 

DF 

MEAN SQUARE 

F RATIO 

BETWEEN 

12091 .4609 

2 

6045.7305 

1.6961 

u; I THIN 

623795.6250 

175 

3564.5464 


TOTAL 

635887.0625 

177 




PROB. F EXCEEDED 
.1864 
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Concluding Remarks 

These supplemental analyses confirm the earlier observa- 
tions of the Final Report, and the most forceful conclusion 
of this second study rests in echoing the sentiments of that 
earlier Report 

The data studied here show clearly that in a statis- 
tical sense there are real differences in several parameters of 


physical importance for the displays under consideration. 
By considering the means and their associated confidence 
intervals one can proceed to draw legitimate engineering 
and policy conclusions. 

The data obtained under HUD-phase III is a valuable 
resource, and as subsequent questions are raised about 
flight displays, it will continue to be one of the steadiest 
guides available. 
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APPENDIX E 


COPILOT/OBSERVER CHECKLIST AND DATA SHEET 


Date 

Subject 

Landing data card and briefing 
Pre-run checklist: 

Flaps: 15 Speed bug : set 

Gear: up Alt bug: set 

Power: set Heading bug: set 

Final descent checklist: 

No smoking - Antiskid -Flight and nav inst 
Landing gear - Flaps - Hydraulic and brake pressure 

Captain’s callouts (check yes or no): 

Target speed 

OM altitude 

100 ft above 

Comments: 


Observer 
Run No. 


Autopilot: as required 
F.D. panel: set 


Minimvims 

1000 ft 

Ground contact 


124 



APPENDIX F 


ATC SCRIPT 


1 . ATC 1 (1500 ft initial altitude) 

At operate, 

“NASA 710, maintain present heading 
with radar vectors to final approach 
at Moffett.” 

At operate + 30 sec, 

“Turn (R or L) to heading (125° or 55°). 
This is your intercept heading, you’re 
cleared for a(n) (localizer front course, 
ILS) approach to runway 9. Report at 
the outer marker inbound.” 

2. ATC 2 (2500 ft initial altitude) 

At operate, 

Same as ATC 1 * 

At operate +15 sec, 

“You’re cleared to descent and maintain 
1500 ft.” 

At operate + 30 sec. 

Same as ATC 1 . 


3. ATC 3 (4000 ft initial altitude) 

At operate. 

Same as ATC 1 . 

At operate +15 sec, 

“You’re cleared to descend and maintain 
1500 ft.” 

At operate + 30 sec. 

Same as ATC 1 . 

4. For all scenarios, after aircraft passes outer marker - 

“The ceiling is reported at XXX ft, visibility is 
XX miles, winds are XXX deg at XX knots. 
You’re cleared to land.” 

“We’ve got one on the runway for departure; 
continue your approach, we’ll keep you 
advised.” 

Followed in 20 sec by, 

“Ceilings reported at XXX ft, RVR is XXX, 
winds from XXX at XX knots. Cleared to 
land.” 


125 



APPENDIX G 


TEST PILOT QUESTIONAIRES AND INSTRUCTIONS 


NASA-Ames Research Center 


Test Pilot Questionnarre 


Head-up Display 


Note: This study is designed to assess the advantages and'disadvantages of the 
headup display concept for possible use in commercial aviation. All 
information you give on this form will be kept confidential and will be 
summarized statistically. 


[Please print all answers) 
Name: 


Leave blank 
Subj. assigned code: 

Exp. No.: . 

EOT: 

EOT: 

Vis. Tests: 

Form Compl 


Address: — zip 

Phone (office prcf.) [ ] Birihdate: 

Do you wear spectacles while flying? yes no (circle ) 

If you have no military experience skip questions la. - Id. 


la. Military Background: Branch 

b. Did you receive military pilot training? yes no (circle) 

c. List aircraft types in which you trained (if applicable - otherwise leave blank): 

1st. 2nd 

3rd 4th 

d. List all aviation-related (specialized) training: 

(continue on opposite side if necessary) 

2. List all pilot associations in which you are now a member: 


i 

3. List all airlines and military commands you have [ ] 

ever flown for beginning with the most recent: j j 

(Insert in brackets the approximate starting date [ ] 

for each) j j 

(continue on opposite side if necessary) [ ] 


« 

4a. Total hours flown (approx.) 4b. Years flying since solo: 

not including Flight Engr.: 

5. Flight Experience Breakdown by Aircraft Type/Model: 

Using your log book as necessary, try to be as complete as possible on this question. Include your Civil (non- 
commercial-private). Airline, and Military flight experience in this table following the sample given. Place a check 
in the small box for those aircraft for which you hold a ‘type' rating. 

SAMPLE 


A : r*. 



Crew Position 

Type/ Model 


Pilot 

Copilot 

Instr. 

Fit. Engr. 

Other 

B 707 

rp\ 

V 

c 


Hrs. 




/XCO y 


a 



g-79 / S-77 

> c 

-f-a 1 9~73 

/ 


/ 

m 

^ 

Dates 


^^rom/To-^ 


• Qieck here 
if ‘type' 
rated 


“Check one for 
c = civil 
a = airline 
m = military 


Insert total hrs. at top of box- 
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NASA-Ames Research Center 


Test Pilot Questionnaire 


Head-up Display 


5. Flight Experience Breakdown by Aircraft Type/Model: (continued) 




■ 

Crew Position 

Aircrait 

Type/Model 


PUot 

Copilot 

Instr. 

Fit. Engr. 

Other 


c 


Hrs. 






1. 

a 





/ 



n 

m 


Dates 

/ 

/ 

/ 

/ 


c 


Hrs. 







a 








n 

m 


Dates 

/ 

/ 

/ 

/ 

/ 


c 


Hrs. 






3. 

a 



/ 





n 

m 


Dates 

/ 

/ 

/ 

/ 

/ 


c 


Hrs. 






4. 

a 








n 

m 


Dates 

/ 

/ 

/ 

/ 

/ 


c 


Hrs. 






5. 

a 





/ 



n 

m 


Dates 

/ 

/ 

/ 

y 

/ 


c 


Hrs, 






6. 

a 








m 

m 


Dates 

/ 

/ 

/ 

/ 

/ 


c 


Hrs. 






7. 

a 



/ 

/ 

/ 

/ 


n 

m 


Dates 

/ 


c 


Hrs. 






8. 

a 



/ 





n 

m 


Dates 

/ 

/ 

/ 

/ 


c 


Hrs. 






9. 

a 








n. 

m 


Dates 

/ 

/ 

/ 

/ 

/ 


c 


Hrs. 






10. 

a 








n 

m 


Dates 

/ 

/ 

/ 

/ 

/ 


c 


Hrs. 






11. 

a 








1 

m 


Dates 

/■ 

i 

/ 

i 



c 


Hrs. 






12. 

a 








n 

m 


Dates 

/ 

1 

! 

1 

/ 


Are you Cat. 11 rated? 

If *‘yes" specify type(s) of aircraft: 
(3) 

yes 

m 

no 

( circle ) 

(4) 



Are you Cat. Ill qualified? 

yes 

no 

(circle) 

If '‘yes" specify tvpe(s) of aircraft: 

(1) 


(2). 

(3) 

_(4) 




8. Summary of Reduced Visibility Landing Experience: 

Insert in each appropriate box the number of landing you have made in the weather conditions noted in the table 
on following page. 
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NASA-Ames Research Center 


Test Pilot Questionnaire 


Head-up Display 


8. Summary of Reduced Visibility Landing Experience: (continued) 


Cumulatively 
within 
the past 


Weather 

Condition 


Category I 

Category 11 

Manual 

Coupled 

Manual 

Coupled 

DAY 

6 months 





TIME 

12 months 





ONLY 

2 years 





NIGHT 

6 months 





TIME 

12 months 





ONLY 

2 years 






9. Head-up Display Experience; 

For purposes of tliis questionnaire, a head-up display is defined as a visual display of fliglit information located in the 
field of view when looking outside through the forward windshield. It may be electro-mechanical or cathode- 
ray driven. 

9a. Have you ever flown an aircraft(s) that had a head-up display? yes no 

b. If “yes" specify type of aircraft and approx, number of hours for each one in brackets: 

(1) [ 1 (2) [ ] (3) [ 1 

c. If “yes" place an asterisk (♦) in ah those spaces of question 9b. if the head-up display you used presented IFR informa- 
tion suitable for making a “/anding" as opposed to weapons delivery type of display. 

d. Have you ever made instrument approaches using a head-up display? yes no 

e. If “yes" specify approximate number of such approaches: 

10. What is your professional opinion of head-up displays for commercial aviation? 


1 1. Wliat is your professional opinion of the autoland concept for commercial aviation? 


12. Based upon what you now know about head-up displays. list below the benefits (advantages) and limitations 
(disadvantages) which you think apply to its use in commercial aviation operations? 

a. Benefits (advantages) 

Most important: 

Next most important: 

Next most important: 

Next most important: 

Ne.xt most important: 

Next most important: 

(continue on opposite side if necessary) 
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NASA-Ames Research Center 


Test Pilot Questionnaire 


Head-up Display 


12b. Limitations (disadvantages) 

Most important: 

Next most important: — — 

Next most important: . 

Next most important: 

Next most important: 

Next most important: 

(continue on opposite side if necessary) 

13. Narrative Description. of the Most Extreme Landing Conditions you have ever Encountered. 

Please describe, using as much detail as you desire, the most extreme landing conditions (environmental, procedural 
inside the cockpit, etc.) with regard to the following basic categories: (continue on opposite side as necessary) 

a. Headwind: — 


b. Tailwind: 


c. Wind Shear: 


d. Other Unusual Weather (e.g., precipitation): 


e. Niglittime Visual Illusions: 


f. Daytime Visual Illusions: 


g. Intermittent Visual Conditions (including unexpected visual range reductions): 


h. Others: 


Thank you for providing us with this useful information 


-4- 
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HUD DEBRIEFING QUESTIONNAIRE 


To help us understand the results we get from this study, please answer the following questions: 


1 . How confident do you feel in your understanding and ability to effectively and safely use the HUD? 


Much less confidence Much more con- 

than with conven- | | | 1 1 1 1 1 1 1 I fidence than with 

tional instruments -10 0 +10 conventional 

instruments 


2. Using the conventional instrument panel as a reference, rate the HUD on each of the following characteristics by 
placing a mark on the line. You may explain your ratings in item 3. 

Lateral Flightpath Control LOCALIZER 

r 1 1 1 1 1 1 1 1 1 1 

-10 0 +10 

Vertical Flightpath Control GLIDE SLOPE 

HUD very much I I I I I I I I I I I HUD very much 

more difficult than -10 0 +10 easier than panel 

panel 

Vertical FUghtpath Control NONPRECISION 

I 1 1 1 1 1 1 1 1 1 1 

-10 0 +10 

Speed Control and Thrust Management 

I 1 1 1 1 1 1 1 1 1 1 

-10 0 +10 

3. General comments about ratings in item 2. 

4. During the “Radar Vectoring” part of the scenarios you flew, rate the HUD with regard to general “situation aware- 
ness.” Did you always know where you were? Where the Localizer and Glide Slope were? Use the conventional instrument 
panel (ADI and Flight Director, HSI, and RMI) as a reference. 


HUD very 
much worse than 
instrument panel 


T 

0 


HUD very much 
better than instru- 
ment panel 


5. Did you find the information on the HUD to be sufficient? Did you desire more information? Please be specific. 
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6. Did you ever refer to the instrument panel when flying using the HUD? If yes, what did you look at? 

Why? Explain. 

7. Using the conventional instrument panel as a reference, rate the HUD on the following characteristics. You may 
explain your reasons in item 8. 


Ability to detect wind shears 

1 1 1 1 1 1 1 1 1 1 

-10 0 +10 


High crosswind landings 

HUD very I * 1 \ 1 1 * 1 1 1 * 

much worse than ® 

instrument 

panel Initiation of missed approach 

I 1 1 1 1 1 1 1 1 1 1 

-10 0 +10 

Detection of runway obstructions 

I 1 1 1 1 1 1 1 1 1 1 

-10 0 +10 


8. General Comments about ratings in item 7. 

9, Do you believe the HUD provides any advantages with reference to the conventional instrument panel? 

If so, what? Please be specific. 

10. Do you believe the HUD provides any disadvantages with reference to the conventional instrument panel? 

If so, what? Please be specific. 

11. All things considered, rate the HUD on the following scale. Base your answer on as many factors as you can — 
safety, economics, passenger comfort, etc. 

I strongly In strongly 

prefer the * * • • * ^ I * ' * < prefer the 

conventional ° HUD 

panel 

12. List the factors you considered for rating in item 10 in order of importance, starting with the most important. 

13. General comments about the HUD. 


HUD very much 
better than 
instrument 
panel 
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THE TRAINING PROGRAM 


This section is designed to help us evaluate the effectiveness of the training program used in this study. Your input will 
be most helpful in designing better training programs. 

The training package consisted of four basic components, the handout material, the classroom session, the video tapes, 
and simulator training. Please evaluate each of these using the scale below. Note that each scale has an “overrun.” If you feel 
the material was overdone or misleading, please place your mark in the appropriate space. 

1. Handout material 

Misleading 0 

“negative ^ — 

training” Contributed 

nothing 

Comments: 


2. Classroom lecture 

Misleading 0 

“negative * ’ 

training” Contributed 

nothing 

Comments: 


3. Videotapes 

Misleading 0 

“negative * 

training” Contributed 

nothing 

Comments: 


4. Simulator training 

Misleading 0 

“negative • 

training” Contributed 

nothing 

Comments: 


10 Overdone 
_l I 

Completely 

effective 


10 Overdone 
_J I 

Completely 

effective 


10 Overdone 
_J I 

Completely 

effective 
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5. Please indicate your assessment of the overall effectiveness of the training program. 

0 10 
I i i I I 1 I I 1 1 I 

Contributed Completely 

nothing effective 


Comments: 


6. How would you change the training program? Please be specific. 


7. Considering all of the above, if this study were to be updated using improved training programs, would the results 
and conclusions be; 

Probably Probably 

very * * * * * ^ ^ ^ the same 

different 

8. General comments about the training program. 
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SUBJECT PILOT DEBRIEFING QUESTIONNAIRE 


Introduction 

In order to obtain as much information as possible from your participation in this study, we would appreciate it if you 
would take some time to complete the following questionnaire. Please attempt to be concise and specific, but try to give us 
as much information and insight as you can. As with all other data obtained in this study, your name will not be used in 
connection with your responses to these questions. 


The Simulation 

This section of the questionnaire is designed to help us to evaluate the quality of the simulation used to conduct the 
evaluation. 

1. On the scale below, please place a mark at the spot you believe best represents Xh& flying characteristics ox handling 
qualities of the aircraft simulated in this study. 


Totally uhlike I I I i i i i I 

the B-727 o 

2. How did the flying characteristics differ from the B-727? Please be specific. 

3. How realistic were the low visibility effects you saw in this study? 


J 

10 


Exactly like 
the B-727 


Totally unlike 

similar real world L 

conditions ® 


Exactly like 
J similar real world 
conditions 


4. How did the low visibility effects differ from real world conditions? Please be specific. 

5. How realistically were the wind and turbulence conditions simulated? 


Not at all like 

real world wind L 

and turbulence ® 


Exactly like 
real world wind 
and turbulence 


6. How were the winds and turbulence different from real world conditions? Please be specific. 

7. How realistic were the runway obstruction situations used in this study? 


Very ■ ■ ■ ■ i I I I I i i Very 

unreal 0 10 realistic 
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8. Considering all of the above, if this study were repeated using an actual B'727 airplane flying in the same conditions 
simulated would the results and conclusions reached be: 


Probably 
the same 

9. General comments about the simulator and test conditions. 


Probably very , i i i 

different 0 io 
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CREW PROCEDURES AND CALLOUTS 


Each air carrier uses somewhat different crew procedures and callouts. Furthermore, the use of HUD would require the 
development of specific procedures and callouts. To assist in the evaluation of the procedures used in this evaluation, please 
answer the following questions: 

1 . In this study, we asked you, the flying pilot, to make most routine callouts. Does your company use this procedure? 

2. With regard to routine callouts, were there too many? 

Just right? 

Too few? 

3. Did you find the deviation callouts by the copilot useful? 

4. How would you change the procedures and callouts? Please be specific. 

5. Given a single HUD in the cockpit, would you, the Captain: 

(a) Prefer to fly the approach yourself with the HUD. 

(b) Monitor the approach through the HUD while the First Officer flies the approach on panel instruments. 

(c) Monitor the panel instruments while the First Officer flies the approach using the HUD. 

(d) Prefer to fly the approach yourself using panel instruments. 

6. Given two HUDS in the cockpit, how would you manage the approach? 

(a) Both pilots head-up, captain flying. 

(b) Captain head-up and flying, first officer head-down. 

(c) First officer head-down and flying, captain monitoring through HUD. 

(d) First officer head-up and flying, captain monitoring head-down. 

(e) Captain head-down and flying, first officer monitoring HUD. 

(f) Other (please specify). 

7. Considering all the above, if this study was repeated using different cockpit procedures and callouts, would the 
results and conclusions reached be: 

Probably very i i i i i i i i i i i Probably the 

different o 10 same 
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General Comments 


Please feel free to comment on any aspect of this study. How could we do a better job? What have we forgotten to 
ask about? 
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TABLE l.-FSAA MOTION LIMITS 


Axis (parameter) 

Displacement^ 

Velocity^ 

Acceleration^ 

RoU 

(0) 

±0.663 rad 

±1.75 rad/sec 

±2.09 rad/sec^ 

Pitch 

(«) 

±0,349 rad 

±1.01 rad/sec 

±2.62 rad/sec^ 

Yaw 

m 

±0.436 rad 

±0.90 rad/sec 

±1.68 rad/sec^ 

Longitudinal 

(X) 

±1.0 m 

±2.1 m/sec 

±2.4 m/sec^ 

Lateral 

(Y) 

±12.2 m 

±8.7 m/sec 

±2.4 m/sec^ 

Vertical 

(Z) 

±1.3 m 

±2.6 m/sec 

±3.7 m/sec^ 


'^Maximum displacement allowed by the parabolic limiter. 

^Maximum velocity reached under a maximum acceleration starting 
from rest at one end of the available travel and driving into the para- 
bolic limiter at the other end. 

^Maximum instantaneous acceleration. 


TABLE 2.- SUBJECT PILOT INFORMATION 


Pilot 

Age 

Airline 

Hr/yr 

HUD 

experience 

A-' 

44 

A 

9.2K/22 

No 


42 

B 

lO.OK/19 

Yes 

c^ 

43 

c 

10.6K/22 

No 

If 

43 

D 

13. OK/24 

Yes 

E 

36 

E 

9.5K/16 

No 


42 

F 

13.5K/20 

No 

G 

41 

G 

12.0K/20 

No 

H« 

45 

A 

10.2K/25 

No 

1“ 

47 

H 

12.0K/25 

No 

f 

43 

I 

8.5K/21 

No 


TABLE 3.- CEILING AND VISIBILITY 
CONDITIONS 


Approach type 

Ceiling, ft 

Visibility, ft 

1 

250 

3000 

Precision 



2 

400 

6000 

1 

500 

7000 

Nonprecision 



2 

j 

800 

12000 


^Also possesses military flight experience. 


TABLE 4.- WIND AND TURBULENCE 


Case 

Wind 

Turbulence, 

Speed, knots 

Direction, deg 

rms ft/sec 

Headwind 

10 

20® off 
localizer 
course 

1.0 

Quartering 

tailwind 

20 

135® off 
localizer 
course 

2.0 

Crosswind 

20 

80® off 
localizer 
course 

3.0 
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TABLE 5.- SUMMARY OF CORE EXPERIMENTAL 
DESIGN 


Winds 

Ceiling and visibility 

Well above 
minimums 

Near minimums 

40® 1 
ILS 

80® 2 
NPA 

25® 3000 
ILS 

50® 1 
NPA 

Headwind, 
10 knots 





Crosswind, 
20 knots 





Quartering 
tailwind, 
8 knots 






TABLE 6.- INTERCEPT SEGMENT DATA 


Variable 

ILS 

NPA 

No HUD 

FDHUD 

FP HUD 

No HUD 

FDHUD 

FPHUD 

OMALT M 

1479. 

1429. 

1429. 

1532. 

1509. 

1516. 

SD 

92. 

43. 

79. 

121. 

84. 

82. 

MAX 

2041. 

1541. 

1853. 

2026. 

1843. 

1914. 

MIN 

1374. 

1349. 

1359. 

1362. 

1234. 

1404. 

OMYCG M 

9.2 

0 

23.0 

-13.1 

15.1 

77.6 

SD 

225. 

300. 

399 

221 

102 

279 

MAX 

519 

1035 

2053 

886 

239 

1345 

MIN 

-827 

-1825 

-1058 

-614 

-256 

-436 

OMVQVR M 

5.2 

4.9 

5.7 

6.7 

4.3 

3.9 

SD 

6.9 

5.6 

7.0 

6.5 

7.0 

6.3 

MAX 

28.4 

20.2 

29.6 

28.4 

20.5 

27.9 

MIN 

-11.5 

-5.1 

' -9.1 

-5.4 

-19.6 

-9.6 

lALT M 

1568 

1566 

1542 

1566 

1520 

1554 

SD 

140 

208 

121 

150 

129 

137 

MAX 

2218 

2902 

2027 

2277 

1845 

2034 

MIN 

1436 

1396 

1431 

1414 

1010 

1369 

IVQVR M 

7,6 

4.9 

8.0 

7.9 

4.8 

7.3 

SD 

6.1 

8.2 

9.1 

7.3 

6.8 

8.3 

MAX 

23.7 

22.9 

30.0 

27.3 

26.9 

30.6 

MIN 

-.9 

-30.5 

-10.9 

-2.3 

-9.9 

-7.5 





TABLE 7.- OUTLIERS GREATER THAN ONE DOT 
LOCALIZER ERROR AT OUTER MARKER 

Display Subject Case Wind OMYCG Altitude 

No HUD 4 8 315^ @ 15 886 1500 

8 6 170® @20 -827 1500 

FDHUD 3 2 315® @ 15 1035 1500 

5 5 225® @ 15 -1825 2500 

FPHUD 5 8 315® @ 15 1345 4000 


TABLE 8.- APPROACH SEGMENT DATA 


Variable 


ALOC 


AEASM 


AEASD 


AHDOTMAX M 
SI 


AHDOTM 


AHDOTD 


ILS 



NPA 

No HUD 

FDH 

:uD 

FPHUD 

No HUD 

FDHUD 

1 

FPHUD 

0.13 

0 

.09 

0.06 

0.14 

0.05 

0.07 

.10 


.15 

.08 

.14 

.04 

.09 

.52 

1 

.09 

.39 

.81 

.27 

.49 

.03 


.01 

.01 

.01 

.01 

.01 

.11 


.07 

.05 

.43 

.48 

.57 

.08 


.04 

.06 

.27 

.25 

.22 

.51 


.25 

.32 

1.24 

1.05 

1.15 

.03 


.02 

.01 

.10 

.09 

.20 


138.2 

5.4 

51.8 

28.9 

3.00 
1.18 
6.41 
1.27 

22.7 
5.4 

14.7 

36.7 

12.8 

2.0 
-9.3 
21.0 


136.7 
.1 
.3 
.5 

.04 
.79 
.14 
.74 


137.0 

4.2 

48.3 

30.9 

2.78 

1.41 

7.37 

.54 

16.3 
4.0 

11.9 

34.4 


138.5 

3.9 

152.1 

133.0 

2.85 

1.25 

8.78 

1.58 

-24.2 

5.5 

-16.5 

-44.0 

-15.3 

2.0 

-9.0 

-18.8 


138.6 

4.1 

150.4 

131.9 

2.85 

1.21 

8.95 

1.21 

-23.5 

2.8 

-19.0 

-31.5 

-17.0 

2.3 

- 11.1 

- 22.2 


4.96 

3 

.17 

1.90 

4.77 

5.03 

5.00 

2.20 

1 

.21 

1.06 

2.64 

2.84 

2.42 

12.10 

6 

.22 

6.39 

13.46 

15.85 

10.24 

2.09 

1 

.13 

.75 

1.97 

1.55 

1.16 




TABLE 9.- SUMMARY OF TOTAL NUMBER OF APPROACHES AND 

GO-AROUNDS 



ILS 

NPA 


No HUD 

FD HUD 

FP HUD 

No HUD 

FDHUD 

FPHUD 

Total 

58 

57 

60 

59 

60 

60 

approaches 
Go-arounds due 

2 

5 

5 

1 

6 

4 

to anomalies 
Other 

0 

0 

0 

4 

3 

0 

go-arounds 








TABLE 10.- SUMMARY OF MIDDLE MARKER DATA 


Variable 

ILS 

NPA 

No HUD 

FDHUD 

FPHUD 

No HUD 

FDHUD 

FPHUD 

MMALT M 

239.7 

234.3 

229.7 

290.0 

302.6 

249.0 

SD 

19.2 

13.8 

7.1 

51.3 

61.4 

43.6 

MAX 

305.0 

264.0 

246.0 

403.0 

459.0 

405.0 

MIN 

204.0 

193.0 

217.0 

184.0 

199.0 

175.0 

MMYCG M 

-13.5 

-3.8 

-3.3 

-9.4 

12.1 

4.9 

SD 

37.1 

12.2 

11.8 

55.1 

85.2 

34.8 

MAX 

126.0 

46.0 

21.0 

164.0 

268.0 

136.0 

MIN 

"111.0 

-33.0 

-71.0 

-114.0 

-125.0 

-74.0 

MMVQVR M 

3.9 

3.1 

2.9 

3.8 

4.1 

4.2 

SD 

4.1 

3.2 

2.6 

4.4 

3.3 

4.3 

MAX 

21.5 

12.4 

8.1 

13.2 

11.3 

17.7 

MIN 

"5.2 

-3.5 

-3.3 

-5.9 

-3.8 

-6.3 

MMHDOT M 

-11.3 

-12.1 

-12.2 

-13.2 

-13.9 

-12.9 

SD 

5.5 

3.3 

1.8 

5.4 

4.5 

2.9 

MAX 

1.9 

-6.5 

-9.1 

-.8 

-.3 

-8.0 

MIN 

-27.1 

-22.1 

-17.1 

-30.9 

-25.0 

-22.1 




TABLE 11.- SUMMARY OF DATA AT RUNWAY THRESHOLD 


Variable 

ILS 

NPA 

No HUD 

FDHUD 

FPHUD 

No HUD 

FD HUD 

FP HUD 

FALT M 

47.5 

52.3 

44.9 

60.1 

69.4 

46.2 

SD 

14.6 

18.2 

7.0 

20.7 

21.7 

15.5 

MAX 

100.0 

100.0 

63.0 

121.0 

142.0 

83.0 

MIN 

19.0 

22.0 

25.0 

10.0 

34.0 

13.0 

FYCG M 

-2.3 

3.1 

4.1 

-5.4 

0 

1.4 

SD 

22.7 

22.1 

18.0 

18.8 

20.6 

12.6 

MAX 

57.0 

59.0 

90.0 

42.0 

38.0 

43.0 

MIN 

-50.0 

-46.0 

-33.0 

-56.0 

-63.0 

-25.0 

FVQVR M 

3.3 

3.3 

2.2 

3.2 1 

4.3 

2.3 

SD 

3.8 

3.9 

2.9 

4.2 

3.9 

3.4 

MAX 

18.2 

17.8 

8.5 

11.6 

18.7 

13.3 

MIN 

-2.9 

-3.7 

-2.9 

-8.2 

-4.2 

-4.4 

FHDOT M 

-12.6 

-11.6 

-11.0 

-14.4 

-14.8 

-11.3 

SD 

2.9 

2.5 

1.9 

3.3 

3.3 

2.9 

MAX 

-6.9 

-6.8 

-7.3 

-7.3 

-9.8 

-2.7 

MIN 

-19.0 

-18.2 

-15.4 

-22.1 

-21.7 

-16.8 


TABLE 12.- SUMMARY OF LANDING DATA 


Variable 

ILS 

NPA 

No HUD 

FD HUD 

FPHUD 

No HUD 

FD HUD 

FPHUD 

LXCG M 

1492 

1720 

1751 

1815 

1901 

1807 

SD 

626 

692 

372 

682 

710 

487 

MAX 

3120 

3253 

2570 

3292 

3144 

2727 

MIN 

510 

531 

864 

235 

731 

708 

LYCG M 

1.0 

2.9 

5.6 

3.1 

.8 

1.9 

SD 

14.1 

16.0 

12.6 

12.9 

15.1 

10.7 

MAX 

50.5 

44.0 

35.5 

33.0 

40.0 

53.0 

MIN 

-25.5 

-48.0 

-14.0 

-42.0 

-35.0 

-32.0 

LMAXVEQ M 

132.6 

132.6 

130.5 

132.1 

133.7 

130.5 

SD 

5.1 

4.5 

5.7 

4.8 

4.7 

5.8 

MAX 

145.5 

144.2 

153.2 

141.8 

142.6 

150.5 

MIN 

123.5 

122.3 

120.5 

116.0 

122.2 

122.2 

LMAXHDOT M 

-3.5 

-3.2 

-2.9 

-3.5 

-3.0 

-2.8 

SD 

1.8 

1.3 

1.0 

1.3 ! 

1.2 

1.4 

MAX 

-1.1 

-1.1 

-.6 

-1.2 1 

-.7 

-.4 

MIN 

-9.9 

-6.3 

-5.3 

-8.4 

-5.6 

-9.7 




TABLE 13.- SUMMARY OF LANDINGS AND MISSED APPROACHES 
FOR ANOMALY CASES 


Anomaly 

No HUD 

FD HUD 

FPHUD 

Landing 

M. A. 

Landing 

M. A. 

Landing 

M.A. 

Wind shear 

5 

0 

3 

2 

2 

0 

Variable visibility 

4 

1 

0 

1 

3 

3 

Low visibility 

3 

0 

1 

1 

3 

0 

Runway obstruction 

0 

2 

0 

5 

0 

6 


TABLE 14.- SUMMARY OF DATA FOR RUNWAY OBSTRUCTION 

ANOMALY CASES 


HUD 

ILS/NPA 

Ceiling, 

ft 

Visibility 

Altitude at 
go-around 
initiation, 
ft 

Distance 
from runway at 
G.A. initiation, 
ft 

Lowest 

altitude, 

ft 

No HUD 

ILS 

250 

3,000 

168 

1,700 

110 

No HUD 

NPA 

800 

12,000 

345 

3,580 

335 

FDHUD 

ILS 

250 

3,000 

185 

700 

140 

FD HUD 

ILS 

250 

3,000 

135 

1,250 

65 

FD HUD 

ILS 

250 

3,000 

140 

1,390 

120 

FDHUD 

NPA 

500 

7,000 

N/A 

N/A 

N/A 

FD HUD 

NPA 

800 

’ 12,000 

250 

2,100 

155 

FPHUD 

ILS 

250 

3,000 

115 

1,800 

75 

FPHUD 

ILS 

400 

6,000 

195 

2,929 

162 

FPHUD 

ILS 

400 

6,000 

155 

1,900 

105 

FPHUD 

ILS 

400 

6,000 

no 

1,250 

65 

FPHUD 

ILS 

400 

6,000 

130 

1,500 

120 

FPHUD 

NPA 

500 

7,000 

75 

450 

45 





HUD TYPE 


FLIGHT 

DIRECTOR 


FLIGHT 

PATH 


FLIGHT 

DIRECTOR 


FLIGHT 

PATH 


HUD TYPE 


FLIGHT 

DIRECTOR 


FLIGHT 

PATH 


FLIGHT 

DIRECTOR 

FLIGHT 

PATH 


TABLE 15. SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE NO. 1 


1. How confident do you feel in your understanding and ability to effectively and safely use the HUD? 


Much less 
confidence 
than with 

conventional — 
instruments -10 


5 


9 

3 

7 2 10 

6 11 8 4 

H 1 1 1 ! 1 

0 +10 


Much more 
confidence 
than with 
conventional 
instruments 


x = 5.9 
a = 1.37 


Much less 
confidence 
than with 

conventional j= 
instruments ~10 


8 

5 

7 11 4 

6 9 3 10 2 

— I 1 1 1 1 1 

0 +10 
X = 7.5 
a = 1.65 


Much more 
confidence 
than with 
conventional 
instruments 


There was a general feeling among most pilots that the FD HUD was equal to, or slightly better than, head down 
in their ability to use it, but this feeling was not strong enough to be statistically significant (t-test for one 
sample case). 

"t" = 2.07, '*p'' = not sig. 

Eighty percent of the pilots felt that the FP HUD could be used more effectively and safely than head down 
instruments {significant at 0.001 level for one sample t-test). 

'r' = 4.79, 'V' = 0.99 sig. 


TABLE 16. SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE NO. 2a. 


2a. Using the conventional instrument panel as a reference, rate the HUD on each of the following character- 
istics by placing a mark on the line. You may explain your ratings in item 3. 






11 






Lateral FP Control LOCALIZER 

8 

7 




HUD very 


9 

10 

4 



HUD very 

much more 
difficult 


5 3 

1 1 

6 

2 



much easier 
than panel 

1 1 
-10 

I I \ 1 \ — 

0 

■ ’1 

1 ■ " 

1 

+10 

than panel 




x = 7.0 
a = 1.25 


7 

8 







6 

5 

11 




9 4 


3 

2 

10 



1 1 
-10 

1 i 1 1 1 

0 

1 

1 

1 ■ 

+10 




x = 7.8 
o = 2.39 







A significant preference was found for the FD HUD over head down in lateral flightpath control, 
"t" = 5.07, "p'' = 0.99 sig. 

A significant preference was found for the FP HUD over head down in lateral flightpath control, 
"t" = 3.69, "p" = 0.99 sig. 
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TABLE 17. SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE NO. 2b. 


HUD TYPE 2b. Using the conventional instrument panel as a reference, rate the HUD on each of the following character- 
istics by placing a mark on the line. You may explain your ratings in item 3. 


FLIGHT 

DIRECTOR 


FLIGHT 

PATH 


Vertical hP Control 


HUD very 
much more 
difficult 
than panel 


HUD very 
much easier 
than panel 


x = 6.7 
1.34 


8 11 
4 10 

2 5 


-10 0 +10 

x = 8.4 
a = 1.58 

FLIGHT A significant preference was found for the FD HUD ever head down in vertical flightpath control. 

Dl RECTOR "t" = 4.02, ''p" = 0.99 sig. 

FLIGHT A significant preference was found for the FP HUD over head down in vertical flightpath control. 

PATH "t" = 6.81, "p" = 0.99 sig. 


TABLE 18. SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE NO. 2c. 


HUD TYPE 2c. Using the conventional instrument panel as a reference, rate the HUD on each of the following character- 
istics by placing a mark on the line. You may explain your ratings In item 3. 


FLIGHT 

DIRECTOR 


HUD very 
much more 
difficult 
than panel 


Vertical FP Control 
NONPRECISION 


0 

x-5.9 
a = 1.91 


HUD very 
much easier 
than panel 


FLIGHT 

PATH 


x = 8.1 
a = 1.97 

FLIGHT No significant preference was found for the FD HUD over head down in vertical flightpath control for 

DIRECTOR nonprecision approaches. 

"t" = 1.48, *'p" = not sig. 

FLIGHT A significant preference was found for the FP HUD over head down in vertical flightpath control for nonprecision 

PATH approaches. 

"t" = 4.97, "p" = 0.99 sig. 


146 



TABLE 19. SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE NO. 2d. 


HUD TYPE 


FLIGHT 

DIRECTOR 


FLIGHT 

PATH 


FLIGHT 

DIRECTOR 

FLIGHT 

PATH 


2d. Using the conventional instrument panel as a reference, rate the HUD on each of the following character’ 
istics by placing a mark on the line. You may explain your ratings in item 3. 


HUD very 
much more 
difficult 
than panel 


Speed Control and 
Thrust Management 


11 


10 


9 

6 

3 

2 


1 1 r 

10 

1 1 1 1 r 

0 


— 1 1 

+10 


x = 6.4 
a = 2.22 


11 




10 



7 

5 


9 6 3 

2 

8 4 


-10 


0 

x = 8.0 
a = 2.26 


+10 


HUD very 
much easier 
than panel 


No significant preference was found for the FD HUD over head down in speed and thrust management, 
"t" = 1.96, "p" = notsig. 

A significant preference was found for the FP HUD over head down in speed and thrust management, 
"t" = 4.19, "p" = 0.99 sig. 
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TABLE 20(a).- SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE - FD HUD 
Question 3. General comments about ratings in item 2. 

Subject Pilot Comments 


2 No comments 

3 On NPA, I would feel better if I had IVSI. 

4 No comments 

5 I find no advantage to HUD while IFR. When VFR, it is helpful to have instrument data overlaying the runway especially on NPA. 

6 Donut seems too large for good altitude control in level flight, but it is very good for glide path control. Could be made smaller. 

7 Lateral control with large crosswind is excellent. I found myself not really aware of a large heading correction. Glide slope was about the same as 

conventional except it would be easier if “contrast” of glide slope and localizer bugs were enhanced. A little harder to pick up trends with digital 

airspeed. Airspeed worm is good but needs to be more visible. Thrust display good except I would like all three engines. I could make small 
adjustments with center engine only. 

8 HUD appeared easier on localizer approach once established on localizer. I was more aware of airspeed and altitude. It eliminated a lot of items 
not needed in scan. On NPA, once runway came into view, HI-LO was useful. Would eliminate a lot of short landings especially at night. 

9 Harder for me to use fixed depression line and delta gamma than just eyeball. Symbols tend to confuse and block out vision during final phases 
of approaches. 

10 Vertical and lateral flightpath better than conventional because of increased scale and reduced scan. Only slightly better than on nonprecision. 
Speed and thrust better, but only because the display is integrated. 

1 1 General approach parameters much easier with HUD. Thrust control easier with EPR within scan of HUD. Airspeed without the standard needle a 
little harder because of rate that needle moves sometimes determines amount of thrust needed to stop needle. 



TABLE 20(b).- SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE - FD HUD 


Question 3. General comments about ratings in Item 2, 

Subject Pilot Comments 

2 The big improvement over head down is the expanded size of the display. Vertical direction of aircraft is not as great an improvement in the HUD 
because the VG display head down is fairly large and easy to maintain a pitch attitude. 

3 With more time, I think my ratings would all be much higher on the plus side. 

4 Had some problems with lead-in when turning to intercept localizer. The presentation heads down seems easier to use to line up. Once lined up, HUD 

does better maintaining. 

5 Localizer was better than flight director, but not as much better as glide slope, speed and thrust management. NPA on a scale of 1 to 10 is a 20. 

6 Once established on localizer, I feel much better with the HUD. Descending turns to intercept localizer prove to be more disorienting than head down. 

7 In general, once established on ILS, HUD is much easier to fly especially on high crosswind approaches. It is extremely valuable when making transi- 

tion and continuing descent, especially on NPA and on ILS when weather is marginal. 

8 Once established on localizer, very easy to maintain localizer with HUD. Same for glide slope. On NPA, I thought the HUD takes the uncertainty out 
of knowing when to leave MDA by using the 3° line. Also, the MDA line is useful in approaching and maintaining MDA. With reference to speed worm 
and potential flightpath, I was able to fly a more stable approach by not having to jockey power levers. 

9 Localizer moves too fast. In capture mode, if in a turn and descending, cannot see localizer bar. OK once established on approach. With HUD, easier 
to see glide path deviation and gives better picture of aircraft position. Speed control somewhat distracting. Airspeed changes are rapid and worm 
sometimes gives impression of being very far out of airspeed envelopes. No power presentation available. Need some reference for power settings to 
prevent loss of control due to very large windshears. 

10 The much expanded scale of reference and fine line precision simply make the whole task easier. The caret showing almost instantaneous speed trend 
is a big plus. In wind shear, particularly m poor visibility, flight path vector seems to give a real jump on short landing threat. 

1 1 Much less scan time involved. Speed and thrust control info is excellent. 



TABLE 21. SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE NO. 4 


HUD TYPE 

4. During the "Radar Vectoring" part of the scenarios you flew, rate the HUD with regard to general. 


"situation awareness." 

Did you always know where you were? Where the localizer and glide slope were? f 


Use the conventional instrument panel (ADI and Flight Director, 

HSI, and RMI) as a reference. 

FLIGHT 

HUD very 


10 



HUD very 

DIRECTOR 

much worse 

7 

9 

11 

4 

much better 


than 

6 5 

8 

3 

2 

than 


instrument i 1 — 

— \ 1 — 

j 

— 1 r- 

— 1 r 

1 \ instrument 


panel -10 



0 


+10 panel 





X = 4.4 







a = 1.65 



FLIGHT 

HUD very 


7 


8 

HUD very 

PATH 

much worse 


6 

11 

4 

much better 


than 

9 10 

3 

5 

2 

than 


instrument i 1 — 

— 1 1 — 

— I — 

1 1 — 

1 r 

1 1 instrument 


panel -10 



0 


+10 panel 





x = 5.1 







a = 2.18 



FLIGHT 

Eight out of the ten pilots rated the FD HUD as slightly lower in terms of position awareness, ^ )wever, while 

DIRECTOR 

highly consistent it was not statistically significant in strength (t-test for one sample case). 


"t"= 1.15, "p" 

= not sig. 





FLIGHT 

Three of ten pilots said the FP HUD was better than head down for general position and situation awareness. 

PATH 

Two pilots felt there was some benefit, and the other five pilots felt head down gave better awareness. ISIo 


significant differences were found statistically. 





"t" = 0.144, "p 

" = not sig. 
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TABLE 22(a).- SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE - FD HUD 


Question 5. Did you find the information on the HUD to be sufficient? Did you desire more information? 


Subject 


Pilot Comments 


2 No comments 

3 I would like to see pitch lines like on the other display. 

4 Yes -No 

5 I find HUD deficient in presentation of pitch and roll. Digital readouts more distracting than airspeed and altitude needles. I do not find it necessary 
to fly precisely to the digit. 

6 The information was good for approach but for go-around and vectoring you need more of an HSI type display in order to have a better situation 
awareness. The heading display leaves something to be desired. My objection is that it just gives you a heading without relating it to your position on 
the approach. 

7 Need better pitch info, especially during go-arounds. This would also help in level flight especially in turns. Digital readout of altitude makes it more 
difficult to pick up immediate deviations. 

8 HUD is excellent in approach but clutters scan during vectoring and turning and gives you a moment of uncertainty about your position. 

9 Need some pitch reference. Horizon line is of no use as it represents nothing. Very difficult to maintain altitude on instruments. Altitude hold 
feature always overshot and we had tendency to go below specified altitude. 

10 I distinctly feel that DME should be a part of this display for situation awareness. 

1 1 Yes, sufficient info is available. However, a better system for pitch management upon capture or heading change could be incorporated. 



TABLE 22(b).- SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE - FP HUD 


Question 5 . Did you find the information on the HUD to be sufficient? Did you desire more information? 


Subject 


Pilot Comments 


2 How about flashing the altitude numbers to indicate OM crossing altitude. 

3 Yes, except the OM helps me to know where I am at all times. 

4 Yes -No 

5 Yes - No. I think altitude and airspeed on a declutter mode would be helpful. Below the 5° nose down line there is no descent reference either in 
body angle or descent rate. 

6 Pitch up and pitch down should be marked in 5"^ increments. It was possible to pitch down so far you could lose heading information. Localizer bar 
should be out of view completely until loc capture, then it should appear centered in FPS and then “pull” you toward loc center. When you 
declutter you should still have pitch attitude in case of go-around. 

7 I would like to have vertical speed information and some way to more precisely determine wings level and bank angle. Also it might be valuable to 
know what your power setting is in addition to the thrust vector. 

8 Occasionally when descending below 1500 fpm you would lose the heading scale and you would have to lessen your rate of descent. Also need a 
heading reminder. 

9 Info OK. Course line sometimes confusing. Need to rearrange my thinking in relation to course line. Don’t think course line of that prominence 
necessary. I confused it with localizer as they crossed during capture of localizer. Distracts from localizer. 

10 I would like vertical speed information, 

11 Yes. Heading information at steep rates of descent. 



TABLE 23. SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE NO. 7a. 


HUD TYPE 

7a. Using the conventional instrument panel as a reference, rate the HUD on the following characteristics. 


You may explain your reasons in item 8. 





FLIGHT 

HUD very 

Ability to Detect Wind Shears 

9 



HUD very 

DIRECTOR 

much worse 

6 

7 

8 


much better 


than 

11 3 5 10 

2 

4 


than 


instrument 

( 1 \ 1 1 1 J — 

— 1 — 

— 1 1 — 


instrument 


panel 

-10 0 



+10 

panel 



x = 5.9 







a = 1.91 









7 

11 


FLIGHT 


9 


5 

10 


PATH 


3 

6 

4 2 

8 




1 1 — 1 — 1 — 1 — 1 — i — 

-10 0 

1 

1 1 

+10 




x = 8.2 







a = 1.55 





FLIGHT 

No significant difference was found between the FD HUD and head down. 



DIRECTOR 


"t"= 1.49, "p"=0.83 not sig. 





FLIGHT 

Significant agreement was found between pilots (100 percent) that the FP HUD was superior to head down in 

PATH 

coping with wind shears. 







'Y' = 6.53, 'V' = 0.99 sig. 






TABLE 24. SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE NO. 7b. 


HUD TYPE 7b. Using the conventional instrument panel as a reference, rate the HUD on the following characteristics. 
You may explain your reasons in item 8. 


FLIGHT 

DIRECTOR 

HUD very 
much worse 
than 

instrument 

panel 

High Crosswind Landings 

6 2 

10 

8 

7 3 

I 

11 

5 

9 4 




1 1 
-10 

1 1 

I I 

0 

x = 6.1 
a = 1.73 

1 1 

1 

+10 

FLIGHT 

PATH 



3 

9 

7 

6 2 

5 

8 

4 

11 

10 



1 1 
-10 

1 1 1 

1 1 
0 

x = 7.1 
a = 2.33 

1 1 

1 

+10 


HUD very 
much better 
than 

instrument 

panel 


FLIGHT No significant difference was found between the FD HUD and head down. 

DIRECTOR "t” = 2.01, "p" = 0.92 not sig. 

FLIGHT Significant agreement was found between pilots (90 percent) that the FP HUD was superior to head down in 

PATH coping with crosswinds. 

”t" = 2.84, "p" = 0.98 sig. 
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TABLE 25. SUMMARY OF HUO DEBRIEFING QUESTIONNAIRE NO. 7c. 


HUD TYPE 7c. Using the conventional instrument panel as a reference, rate the HUD on the following characteristics. 
You may explain your reasons in item 8. 


FLIGHT 

DIRECTOR 


HUD very 
much worse 
than 

instrument 

panel 


Initiation of Missed Approach 

7 10 


0 

X = 4.2 
o = 2.57 


HUD very 
much better 
than 

instrument 

panel 


-10 0 +10 

x = 5.9 
a = 1.97 

FLIGHT No significant difference was found between the FD HUD and head down, in fact, a slightly negative relation- 

Dl RECTOR ship was found. 

'Y'= 0.98, "p''= 0.65 notsig. 

FLIGHT No significant difference was found between the FP HUD and head down in coping with a missed approach. 

PATH "t" = 1.44, "p" = 0.81 not sig. 


TABLE 26. SUMMARY OF HUO DEBRIEFING QUESTIONNAIRE NO. 7d. 


HUD TYPE 7d. Using the conventional instrument panel as a reference, rate the HUD on the following characteristics. 
You may explain your reasons in item 8. 


. Detection of Runway Obstructions m 
HUD very 


much worse 
than 

instrument 

panel 


0 

x = 6.5 
o = 2.55 


HUD very 
much better 
than 

instrument 

panel 


X = 6.67 
o = 2.35 


No significant difference was found between the FD HUD and head down. 

'T' = 2.26, V' = 0.94 notsig. 

Significant agreement was found between pilots (80 percent) that the FP HUD was superior to head down in 
coping with runway obstructions. 

"t" = 2.58, "p" = 0.97 sig. 
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TABLE 27(b).- SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE - FP HUD 


Question 8. General comments about ratings in item 7. 


Subject 


Pilot Comments 


2 HUD symbols can mask or distract from an object ahead such as an aircraft on runway. 

3 No comment. 

4 No comment. 

5 The tape worm and flashing symbol was great for speed excursions but I don’t feel that is necessarily a shear detection device. Flightpath info 
relative to heading is great thus allowing interpolation of crosswind. 

6 No attitude information during missed approach if you are in declutter mode. If it weren’t for that I would say it was equal to conventional 
instruments on missed approach. 

7 The main advantage is in recognition of windshears. 

8 You have an instant knowledge of any windshear with the instantaneous readout of airspeed and speed worm. The same with crosswind landings. 
On missed approaches, for a moment there is just a little confusion with the HUD but then you settle down and just fly the HUD. As you are 
already looking out of the window, you can detect any obstruction on the runway immediately. 

9 Able to pick up windshears faster due to 1 knot increments on airspeed indicator. Missed approach easier because you have pitch reference avail- 
able plus visual awareness. Because you are not dividing time between cockpit and outside, obstruction becomes apparent much faster. 

10 On missed approach, display seems very busy at rotation but had I decluttered it may have been much better. At any rate, the flightpath vector 
symbol is super here. On obstructions, this is a simulator environment and pretty tough to relate to real world reality. 

11 No comment. 



TABLE 27(a).- SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE - FD HUD 


Question 8. General comments about ratings in item 7. 


Subject 


Pilot Comments 


2 No comments. 

3 No comments. 

4. No comments. 

5 I followed “command” on HUD, not looking at the runway. Having heading indications above command dot helps pick up the crosswind easier. 
Having no pitch info derogates the proper attitude and thus the performance of the missed approach. Looking at HUD while visual distracts from 
fully viewing the outside world when VFR. 

6 I am much more likely to recognize a shear if I see an airspeed indicator jump than to see a number change. IFR, I would recognize a shear 
sooner with conventional instruments. VFR, I think I would recognize a shear with the HUD sooner. 

7 Good for shears because you can integrate visual cues with the display to detect changes. I would like a major declutter capability. 

8 Can detect windshear very rapidly with HUD. On high crosswinds, you have to divide time between HUD and watching the runway. On initial 
missed approach, it was difficult but once into missed approach, it was easier. No problems on runway obstructions. 

9 The HUD gives better indications of windshear because of its airspeed and heading information. Pick up objects on runway better because you 
are focussing down runway. 

10 Quite helpful in windshear if you are in delta-gamma mode; not much otherwise. Quite good in crosswind if you remain in localizer mode but if 
you do that, you lose the windshear protection. OK for missed approach but not a dramatic improvement. For runway obstruction, the plus of 
early runway detection and minus of view clutter rate a wash here. 

1 1 Airspeed needle movement is much easier to catch for windshears. Installation of go-around button for initial pitch attitude for go-around 
would make HUD better. Runway obstructions with heads up comes into view sooner, hence safer. 



TABLE 28. SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE NO. 11 


HUD TYPE 


FLIGHT 

DIRECTOR 


FLIGHT 

PATH 


FLIGHT 

DIRECTOR 


FLIGHT 

PATH 


11. All things considered, rate the HUD on the following scale. Base your answer on as many factors as you 
can — safety, economics, passenger comfort, etc. 


I strongly 
prefer the 
conventional 
panel 


I strongly 
prefer the 
conventional 
panel 


10 11 
7 9 8 

5 3 6 2 4 

I 1 1 1 1 1 1 1 1 1 1 

-10 0 +10 

x = 6.4 

a = 1,65 

10 

8 

5 11 

6 3 9 7 2 4 

I 1 1 1 1 1 1 "T 1 1 1 

-10 0 +10 


x=8.0 
a = 2.16 


I strongly 
prefer the 
HUD 


I strongly 
prefer the 
HUD 


A significant difference was found between the FD HUD and head down, in that nine of ten pilots felt the 
HUD was equal to or better than head down. However, the ratings were not particularly high (t-test for 
one sample case). 

'V' = 2.69, "p" = 0.98 sig. 

A significant difference was found between the FP HUD and head down (0.001 level of significance for 
single sample t-test). Nine out of ten pilots preferred the FP HUD to head down. 

“t" = 4.39, "p" = 0.99 sig. 
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TABLE 29(a).- SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE - FD HUD 


Question 12. List the factors you considered for rating in item 10 in order of importance, starting with the most important. 


Subject 


Pilots Comments 


2 Safety, passenger comfort. 

3 Something new; something in front of your eyes. 

4 Safety, windshear protection. 

5 Pitch and roll info. Command info too sensitive in display movement but too much tolerance in correction. HUD requires too many aircraft cor- 
rections to fly a comfortable approach for passengers. 

6 Referencing yourself in relation to runway. Altitude control in level flight. Localizer capture (dot takes off abruptly and sometimes hidden behind 
similar dot on side of display). HI-LO bar off to side of runway during large crosswinds. 

7 If used for low visibility approaches only and with declutter capability and more visible airspeed, ^de slope, and localizer info, it would be excel- 
lent. However, for maneuvering and VFR, at this point I prefer conventional instruments. 

8 Localizer, glide slope, airspeed indicator, altitude, engine instruments, raw data. 

9 Outside visibility. Longer time to prepare for landing. Good information without scan of complete instrument panel. 

10 As an approach tool, it’s good, but because of scale and display integration, not because of any leap forward in logic or philosophy. As a maneu- 
vering tool, I believe it to be less than present conventional display. 

1 1 Safety, simplicity, and better display for nonprecision approach. 



TABLE 29(b).- SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE - FP HUD 


Question 12. List the factors you considered for rating in item 10 in order of importance, starting with the most important. 


Subject Pilot Comments 


2 The HUD can provide a means to reduce or eliminate large control and/or power changes. Therefore, smaller deltas mean passenger comfort is 
improved, less stress on airframe and engines, better fuel economy (less excursions from intended flightpath = less fuel) and lower hand flown 
mimimums equals less diversions to alternate airport. 

3 I like a clear view. It’s a new ballgame. With more time, I would give the HUD a higher rating. 

4 Easier to fly. Safety - quicker interpretation of factors to complete safe landing or go-around. Better windshear detection and correction. Direct 
reference for landing points. 

5 Flightpath info now. Thrust and speed control is precise. Speed worm and stickshaker line are very helpful in shear situations. 

6 Outside interference . 

7 Transition to ground contact. Maintaining proper glide slope during last part of descent. Recognizing windshear. 

8 I feel that by using the HUD you will be able to get in when the ceiling is marginal on both the precision and nonprecision approaches. Also where 

fields have no ILS. This would save money by not having to divert to alternate, bussing passengers, hotels, etc. Also save fuel by making it on 
first approach. 

9 More time spent looking out. Simpler scan of heading, airspeed, altitude and flightpath. 

10 Economics. For final approach work, this thing is incomparable. For terminal area maneuvering involving major pitch, speed and particularly alti- 

tude changes, I found it a bit less so. 

1 1 The basic fact that the pilot has guidance for touchdown and minimums on nonprecision approaches plus the fact that the approach is more 
accurate makes HUD much more valuable than standard instruments. 
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TABLE 30(a).- SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE -FD HUD 
Question 13. General comments about the HUD. 

Subject Pilot Comments 

2 No comment. 

3 I like it very much. With more use I would feel more at ease. 

4 I would like to see this used from FAF to landing. There is some problem with large wind corrections when runway appears. Harder to bring run- 

way into scan than with conformal HUD. Much better than head down. 

5 I believe taking a conventional VG presentation of pitch and roll and super-imposing crosshairs for command info and giving the peripheral info 

such as raw data glide slope and localizer, heading, EPR, airspeed and placing it further from the pilot (closer to windshield) would be better. 

6 Overall, I am very impressed with the system, and it is certainly a step in the right direction. With some improvements I think it will be a very 

workable system, and one that any instrument pilot could readily adapt to. With passengers in the back of the aircraft, the system should encour- 
age smoothness which it does not at this time. 

7 With changes I suggested, if HUD was used during instrument approaches much like we use our conventional fli^t director, it would be an excel- 
lent step forward in the art of instrument approaches. 

8 I enjoyed using the HUD. More aware of altitude and airspeed. Confusing on vectoring and turning and initiating go-around. I like HI-LO once I 
learned the switching. 

9 Since this HUD is still just a fli^t director, pilot must change from instruments to visual just as in head down flying. Much more difficult to fly 
than other HUD. The system is better than nothing however. Real world one to one is better. 

10 More accurate for approaches than conventional instruments. Altitude hold is too sloppy. At localizer capture, the steering dot goes zipping right 
across into the dot ladder at other side and gets lost. EPR is of some help but a speed trend display would beat that one in my book. Once again, 
DME. Speed control could be more demanding. In delta gamma with a crosswind, I decrabbed too early, I think due to the nature of the pre- 
sentation. I like vertical speed reference. 


11 


In my opinion, HUD has a future and is needed. 


TABLE 30(b).- SUMMARY OF HUD DEBRIEFING QUESTIONNAIRE -FP HUD 


Question 13. General comments about the HUD. 


Subject 


Pilot Comments 


2 I like it. 

3 I like it very much. 

4 I like it very much. I think it would enable pilots to do a better and safer job flying the aircraft in low visibility and windshear situations. I feel 
that lower minimums would be possible with the HUD. 

5 The HUD is very easy to learn and to operate by using it or having a demonstration. I found it difficult to learn by reading about it. I wish I could 
use it for a few months .in airline flying. It is smooth and comfortable. Except for descent rate, it has all the info needed for making a CAT I/II 
instrument approach. A system warning light would be necessary close by to warn of malfunctions. 

6 I think HUD should enhance rather than replace conventional systems. It will never work 100 percent of the time for all approaches. The conven- 
tional instruments do, however. 

7 In general, I feel it is an excellent display for making approaches, especially in the areas of transition, crosswind tracking, final descent tracking, 
and in recognizing windshears. 

8 I enjoyed flying this HUD very much. I felt very comfortable and at ease in flying it. When returning to flight instruments head down, I was rough 
on controls and had difficulty holding 100 ft whereas with HUD I held the altitude within 20 ft. 

9 The course line kind of snowed me, at least at first. I disliked the way almost all reference info disappears when pitch exceeds about -4^°. The 
level wing portion of the flightpath symbol may possibly give better roll reference at flare if they were longer. 

10 I was very much impressed with the number of items HUD was able to display. After a few runs I had no problems understanding what was pre- 
sented. I like having information available to me during last 300 ft of descent in a CAT II approach. At present, we must rely on copilot to read 
and relay G/S, LOC, airspeed and altitude to us. The system was very difficult to use during an intercept of over 30°. Localizer moves too fast to 
catch it. I don’t like the course line presentation. System excellent once established on final. During approach, hard to determine aircraft actual 
position relative to glide slope. Somewhat confusing to me. Flare command seem to make for landings past the desired 1000 ft point. Suggest 
flare command disappear at -3° indication. 

1 1 Hopefully HUD will be adopted in the future. 



TABLE 31. SUMMARY OF HUD TRAINING QUESTIONNAIRE NO. 1 


HUD TYPE 

1. Handout mater iaf 

Mean 
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Pilots felt both FDandFPHUD handout materials were effective 
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TABLE 32. SUMMARY OF HUD TRAINING QUESTIONNAIRE NO. 2 


HUD TYPE 

2. Classroom Lecture 

Mean 
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Pilots felt that classroom lectures for both HUDs were effective. 
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TABLE 33. SUMMARY OF HUD TRAINING QUESTIONNAIRE NO. 3 


HUD TYPE 


3. Video tapes 


Mean 


FLIGHT 

DIRECTOR 


Misleading 

"negative 

training" 


Contributed 

nothing 


FLIGHT 

PATH 


Contributed 

nothing 




x = 9.0 
a= 1.5 




X = 9.22 
a = 1.09 


Pilots felt that video tapes for both HUDs were effective. 


11 

10 

9 

6 

4 

L_ 


Over- 

done 


Completely 

effective 


11 

10 

5 

4 

3 


7 

2 


Completely 

effective 


8.00 


0.99 


8.85 


0.99 


TABLE 34. SUMMARY OF HUD TRAINING QUESTIONNAIRE NO. 4 


HUD TYPE 

4. Simulator training 

Mean 


"p" 

FLIGHT 

DIRECTOR 

Misleading 

"negative o 4 

training" l . i i i i ^ i i i 

11 

10 

7 9 

3 6 Over- 

2 5 done 

1 1 


18.35 

0.99 

FLIGHT 

PATH 

Contributed x = 9.4 

nothing a = 0.73 

0 4 

1 1 1 1 1 1 1 1 

Completely 

effective 

11 

10 

9 6 

7 5 

2 3 

1 1 


8.73 

0.99 


Contributed x - 9.22 

nothing a = 1.30 

Pilots felt that simulator training for both HUDs was effective. 

Completely 

effective 
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TABLE 35. SUMMARY OF HUD TRAINING QUESTIONNAIRE NO. 5 


HUD TYPE 

5. Please indicate your assessment of the overall effectiveness of the training program. 

Mean 
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9 
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Pilots felt overall effectiveness of both HUD training procedures was effective. 





TABLE 36. SUMMARY OF HUD TRAINING QUESTIONNAIRE NO. 7 


HUD TYPE 

7. Considering all of the above, if this study were to be updated using improved training 
programs, would the results and conclusions be: 

Mean 


"p" 

FLIGHT 

DIRECTOR 

Probably 7 

very 2 5 3 

9 

6 

4 Probably 
10 11 the 


2.89 

0.97 

FLIGHT 

different i 1 i 1 1 ^ 1 1 — 

° X = 7.55 

a = 2.65 

7 4 

1 1 1 same 

11 

10 6 9 

2 3 5 


8.33 

0.99 

PATH 

_ ... -r 

n 1 1 1 1 7T 1 1 

0 x = 8.55 

£7 = 1.42 

! T 1 





Pilots felt improved training programs would have little impact on results and conclu- 
sions. (It should be noted that even though the relationship was statistically significant, 
a = 0.03, the distribution of ratings on the flight director training was very scattered. 

This probably reflects a lack of personal preference for the display, rather than a limi- 
tation in the training package. Even though subjects tended to have more questions during 
the flightpath training, their overall opinions tended to rate the flightpath display higher 
in training.) 

While ail subjects' responses to the training questionnaire were positive and significantly 
different from pure chance, it does not appear that the training questionnaire discrimi- 
nated very well. 
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TABLE 37.- DESIGN STRUCTURE 
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Figure 3.- FP HUD symbology. 


FLIGHT SIMULATOR FOR ADVANCED 
AIRCRAFT (FSAA) 

AMES RESEARCH CENTER 


PRIMARY PURPOSE: 

• LANDING. TAKEOFF & HANDLING QUALITIES 
INVESTIGATIONS 

• CREW TASK EVALUATIONS 

KEY CHARACTERISTICS: 

• 3 MAN COCKPIT 

• 6 DEGREE FREEDOM 

• 50 FT LATERAL TRAVEL 

• PANEL. CENTER & OVERHEAD INSTRUMENTS 



% IMAGE TV DISPLAY 
• AIRCRAFT SOUND GENERATOR 
% DIGITAL COMPUTER 


Figure 4.— Simulator area. 
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Figure 5.— FSAA cockpit layout. 



PLANO-CONVEX LENSES DIRECT-VIEW CRT 


Figure 6 — Schematic view of the HUD lenses and beamsplitter. 
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Figure 9,— Maximum sink rate — approach segment. 
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Figure 10.— Mean sink rate — approach segment. 




NO HUD FD HUD FP HUD NO HUD FD HUD FP HUD 

Figure 1 L- RMS division of sink rate from mean sink rate — approach segment. 
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Figure 12.— ILS approach — lateral displacement and altitude at middle marker for NO HUD case 








Figure 13.- ILS approach — lateral displacement and altitude at middle marker for FD HUD case. 



Figure 14.— ILS approach — lateral displacement and altitude at middle marker for FP HUD case. 
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Figure 15.— Nonprecision approach — lateral displacement and altitude at middle marker for NO HUD case. 
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Figure 16 - Nonprecision approach - lateral displacement and altitude at middle marker for FD HUD case. 
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Figure 17.— Nonprecision approach — lateral displacement and altitude at middle marker for FP HUD case. 
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Figure 18.- Sink rate data at middle marker. 
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Figure 19 — ILS approach 
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Figure 25.— Situation B. 



Figure 26 — Situation C. 
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Figure 27 — Fixed display elements. 
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Figure 28.— Aircraft attitude presentation. 
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040 


050 


Figure 29— Difference between aircraft and runway heading greater than 9°. 



X2 SCALE 

Figure 30 — Flightpath symbol and related elements. 
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HEADING TRACK DIFFERENCE DUE TO: 

1. SIDESLIP 

2. CROSSWIND 

3. RESULTANT OF ANGL E OF- ATTACK 
AND ROLL ANGLE 

Figure 31.- Flightpath symbol and related elements shown in context of aircraft attitude. 
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Figure 32.— Aircraft position relative to approach course. 
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Figure 33.— Course-line symbol. 
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Figure 34.— ILS glide-slope error indications. 
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ABOVE AND LEFT OF PATH 

Figure 35.- Aircraft above and left of ILS. 
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BELOW AND RIGHT OF PATH 

Figure 36.- Aircraft below and right of fLS. 
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ABOVE AND RIGHT OF PATH 

Figure 37.- Aircraft above and right of ILS. 
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ON PATH. 1000 ft FROM THRESHOLD 

Figure 38.— Aircraft on path, 1000 ft from threshold. 
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Figure 39.— Symbol for annunciating and capturing preselected target altitude. 
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Figure 41 Ground-proximity symbol shortly before touchdown. 
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(a) Head-up presentation. 



(b) Head-down presentation. 

Figure 42.— Comparison of head-up and head-down information, aircraft on approach. 
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(a) Head-up presentation. 



(b) Head-down presentation. 

Figure 43.— Comparison of head-up and head-down information, aircraft approaching flare. 
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(a) Head“Up presentation. 
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(b) Head-down presentation. 


Figure 44.— Comparison of head-up and head-down information at touchdown. 




Figure 45— Situation A. 



Figure 46.— Situation B. 
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Figure 47 — Situation C. 
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